Repository info

vllm

• Summary: a summary of vllm
• Description: A high-throughput and memory-efficient inference and serving engine for LLMs
• Stars: 47988
• Number of forks: 7579