Package profile
tokie
- Summary: Blazingly fast tokenizer — 50x faster, 10x smaller, 100% accurate
- Author: not specified
- License: Apache Software License, MIT License
- Homepage: https://github.com/chonkie-inc/tokie
- Documentation: https://docs.rs/tokie
- Source: https://github.com/chonkie-inc/tokie
- Number of releases: 15
- First release: 0.0.3 on 2026-03-23
- Latest release: 0.1.4 on 2026-07-24
- Latest release size: 2.7 MB (wheel)