Repository info

exllamav2

• Summary: a summary of exllamav2
• Description: A fast inference library for running LLMs locally on modern consumer-class GPUs
• Stars: 4185
• Number of forks: 314