Last released Oct 29, 2026
Optimized CUDAgraph-enabled kernels and attention backend for vLLM, SGLang and more based on TurboQuant near-lossless KV cache compression.
Last released Oct 15, 2026
Python client for the ARBI API