Last released Sep 26, 2024
A LLM quantization package with user-friendly apis. Based on GPTQ algorithm.
Supported by