Last released Apr 26, 2026
Quantize small HuggingFace models to multiple formats (GGUF, GPTQ, AWQ, BitsAndBytes, PyTorch)
Supported by