Package profile
auto-gptq
- Summary: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
- Author: PanQiWei
- Homepage: https://github.com/PanQiWei/AutoGPTQ
- Source: https://github.com/PanQiWei/AutoGPTQ (Repo profile)
- Number of releases: 15
- First release: 0.0.4 on 2023-04-26
- Latest release: 0.7.1 on 2024-03-01
Releases
PyPI Downloads
Dependencies
Auto-gptq has 15 dependencies, 4 of which optional.| Dependency | Optional |
|---|---|
| accelerate | false |
| datasets | false |
| gekko | false |
| numpy | false |
| peft | false |
| rouge | false |
| safetensors | false |
| sentencepiece | false |
| torch | false |
| tqdm | false |
| transformers | false |
| parameterized | true |
| pytest | true |
| ruff | true |
| triton | true |