Last released Mar 23, 2026
A general x-bit quantization engine for LLMs,[2-8] bits, awq/gptq/hqq/vptq
Last released Mar 6, 2025
VPTQ (Vector Post-Training Quantization) is a novel Post-Training Quantization method.
Supported by
