Package profile
flashinfer-python
- Summary: FlashInfer: Kernel Library for LLM Serving
- Author: FlashInfer team
- License: Apache-2.0
- Homepage: https://github.com/flashinfer-ai/flashinfer
- Source: https://github.com/flashinfer-ai/flashinfer
- Number of releases: 103
- First release: 0.2.0.post1 on 2025-01-09
- Latest release: 0.7.1rc2 on 2026-10-02
- Latest release size: 17.5 MB (pure Python wheel)
Dependencies
Flashinfer-python has 16 dependencies, 0 of which optional.Dependent packages
| Package | Optional | Group |
|---|---|---|
| megatron-bridge | false | |
| sglang | false | |
| tensorrt-llm | false | |
| vllm | false | |
| gptqmodel | true | vllm |
Similar packages
- litellmLibrary to easily interface with LLM API providers
- llvmlitelightweight wrapper around basic LLVM functionality
- vllmA high-throughput and memory-efficient inference and serving engine for LLMs
- langchainBuilding applications with LLMs through composability
- langchain-classicBuilding applications with LLMs through composability
- langchain-coreBuilding applications with LLMs through composability
- langchain-experimentalBuilding applications with LLMs through composability