3 projects
tessera-quant
Tessera: trellis-coded quantization of LLM weights onto hardware-native NVFP4, FP8 and BF16 tiles, continuous-rate on the FP8 and BF16 grids, with its own vLLM serving plugin
gridbook
vLLM plugin for variable-rate NVFP4-CB / FP8-CB product-codebook LLM quantization served by dedicated CUDA decode and prefill kernels.
prismaquant
Mixed-precision quantization allocator for LLMs: every layer refracts into a different format based on its sensitivity.