Repository info

auto-round

• Summary: a summary of auto-round
• Description: Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Transformers, and vLLM.
• Stars: 472
• Number of forks: 39