Package profile
pyonmttok
- Summary: Fast and customizable text tokenization library with BPE and SentencePiece support
- Author: OpenNMT
- License: MIT License
- Homepage: https://opennmt.net
- Source: https://github.com/OpenNMT/Tokenizer/
- Number of releases: 68
- First release: 1.3.0 on 2018-04-07
- Latest release: 1.38.1 on 2026-01-10
- Latest release size: 229.3 KB (wheel)