Package search
auto-gptq
- Summary: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
- Author: PanQiWei
- Homepage: https://github.com/PanQiWei/AutoGPTQ
- Source: https://github.com/PanQiWei/AutoGPTQ
- Repo profile
- Number of releases: 15
- First release: 0.0.4 on 2023-04-26T06:00:53
- Latest release: 0.7.1 on 2024-03-01T13:09:00
| Dependency | Optional |
|---|---|
| accelerate | false |
| datasets | false |
| gekko | false |
| numpy | false |
| peft | false |
| rouge | false |
| safetensors | false |
| sentencepiece | false |
| torch | false |
| tqdm | false |
| transformers | false |
| parameterized | true |
| pytest | true |
| ruff | true |
| triton | true |