Avatar for Hannu Varjoranta from gravatar.com

Hannu Varjoranta

Username    varjo
Date joined   Joined

2 projects

turboquant-plus-vllm

Last released

TurboQuant+ compression for vLLM. 4.3x weight compression + 3.7x KV cache, zero calibration.

turbo-quant-lite

Last released

Numpy-only TurboQuant vector quantization. No PyTorch, no CUDA.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page