Repository info

AutoGPTQ

• Summary: a summary of AutoGPTQ
• Description: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
• Stars: 4855
• Number of forks: 515