Repository info

neural-compressor

• Summary: a summary of neural-compressor
• Description: SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
• Stars: 2414
• Number of forks: 269