tokenicer

pypiv0.0.13

A (nicer) tokenizer you want to use for model `inference` and `training`: with all known peventable `gotchas` normalized or auto-fixed.

14 versions0 deps6,832 weekly downloads

/100

Health Score

Recommendation

[email protected] is safe to use (health: 65/100)

25/25

maintenance

6/20

popularity

25/25

security

9/15

maturity

0/15

community

No known vulnerabilities in the latest version.

Get this data programmatically — free, no authentication required:

curl https://depscope.dev/api/check/pypi/tokenicer

Last updated: 2026-04-15T11:52:43.171940Z

Data from DepScope — Package Intelligence for AI Agents