Package profile
curated-tokenizers
- Summary: Lightweight piece tokenization library
- Author: Explosion
- License: MIT License
- Homepage: https://github.com/explosion/curated-tokenizers
- Source: https://github.com/explosion/curated-tokenizers
- Number of releases: 12
- First release: 0.0.6 on 2023-05-23
- Latest release: 0.0.10 on 2026-08-24
- Latest release size: 687.1 KB (wheel)