Last released Mar 1, 2024
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Supported by
