tokenizers

cargov0.22.2

Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.

License Apache-2.039 versions0 deps4,964,740 weekly dl
huggingface/tokenizers
69
/ 100
Health
safe to use

[email protected] is safe to use (health: 69/100)

Health breakdown0 – 100
15/25
maintenance
17/20
popularity
25/25
security
12/15
maturity
0/15
community
Vulnerabilities
0
none known

Health History

Dependency Tree

License Audit

API access

Get this data programmatically — free, no authentication.

curl https://depscope.dev/api/check/cargo/tokenizers

First published · 2019-08-08T14:55:49.017781Z

Last updated · 2025-12-02T12:53:51.498043Z

tokenizers — Health Score 69/100 | DepScope | DepScope