Package search

tiktoken

• Summary: tiktoken is a fast BPE tokeniser for use with OpenAI's models
• Author: Shantanu Jain
• Homepage: https://github.com/openai/tiktoken
• Source: https://github.com/openai/tiktoken
• Repo profile
• Number of releases: 15
• First release: 0.1.1 on 2022-12-15T02:26:44
• Latest release: 0.9.0 on 2025-02-14T06:02:01