Is tokenizers.bpe safe to use?

tokenizers.bpe has no known vulnerabilities on the latest version (0.1.4). DepScope rates its health at 40/100 (high risk).

What is the latest version of tokenizers.bpe?

The latest version of tokenizers.bpe is 0.1.4, released 2025-09-05.

Does tokenizers.bpe have known vulnerabilities?

No known vulnerabilities on the latest version of tokenizers.bpe.

Is tokenizers.bpe deprecated?

No, tokenizers.bpe is actively maintained. Latest release: 0.1.4 (2025-09-05).

What are alternatives to tokenizers.bpe?

DepScope has no curated alternatives for tokenizers.bpe at this time.

What license does tokenizers.bpe use?

tokenizers.bpe is licensed under MPL-2.0.

tokenizers.bpe

cranv0.1.4

Byte Pair Encoding Text Tokenization. Unsupervised text tokenizer focused on computational efficiency. Wraps the 'YouTokenToMe' library <https://github.com/VKCOM/YouTokenToMe> which is an implementation of fast Byte Pair Encoding (BPE) <https://aclanthology.org/P16-1162/>.

License MPL-2.0weak copyleft0 versions1 maintainers1 deps162 weekly dl

bnosac/tokenizers.bpe

/ 100

Health

safe to use

[email protected] is safe to use (health: 40/100)

Health breakdown0 – 100

10/25

maintenance

3/20

popularity

25/25

security

0/15

maturity

2/15

community

Vulnerabilities

none known

Health History

Dependency Tree

License Audit

Dependencies (1)

Rcpp

API access

Get this data programmatically — free, no authentication.

curl https://depscope.dev/api/check/cran/tokenizers.bpe

First published · 2025-09-05 17:51:53

Last updated · 2025-09-05T16:30:02+00:00