Package profile
tiktoken
- Summary: tiktoken is a fast BPE tokeniser for use with OpenAI's models
- Author: Shantanu Jain
- Homepage: https://github.com/openai/tiktoken
- Source: https://github.com/openai/tiktoken
- Number of releases: 20
- First release: 0.1.1 on 2022-12-15
- Latest release: 0.14.0 on 2026-08-17
- Latest release size: 1.0 MB (wheel)
Dependencies
Tiktoken has 3 dependencies, 1 of which optional.Dependent packages
| Package | Optional | Group |
|---|---|---|
| aiperf | false | |
| autogen | false | |
| automated-interpretability | false | |
| crewai-tools | false | |
| databricks-agents | false |
Similar packages
- langchain-openaiAn integration package connecting OpenAI and LangChain
- openai-agentsOpenAI Agents SDK
- openapi-codecAn OpenAPI codec for Core API.
- openaiThe official Python library for the openai API
- pytokensA Fast, spec compliant Python 3.14+ tokenizer that runs on older Pythons.
- openapi-coreclient-side and server-side support for the OpenAPI Specification v3
- langchain-google-vertexaiAn integration package connecting Google VertexAI and LangChain