6 projects
fp-quant
A Python library for FP-Quant
qutlass
Temp
quartet-qat
A Python library for Quartet QAT
aqlm
Efficiently run models quantized with AQLM
MiniFL
A smal framework for reproducing FL experiments
tensor-parallel
Automatically shard your large model between multiple GPUs, works without torch.distributed
