Package search
icetk
- Summary: A unified tokenization tool for Images, Chinese and English.
- Author: Wendi Zheng and Ming Ding
- Homepage: https://github.com/THUDM/icetk
- Source: https://github.com/THUDM/icetk
- Repo profile
- Number of releases: 7
- First release: 0.0.1 on 2021-12-22T17:57:58
- Latest release: 0.0.7 on 2023-03-23T16:37:55
Dependency | Optional |
---|---|
filelock | false |
protobuf | false |
requests | false |
sentencepiece | false |
torchvision | false |
tqdm | false |