Repository info

vllm

• Summary: a summary of vllm
• Description: A high-throughput and memory-efficient inference and serving engine for LLMs
• Stars: 52138
• Number of forks: 8673