Avatar for Srihari Unnikrishnan from gravatar.com

Srihari Unnikrishnan

Username    iampoppyxx
Date joined   Joined

2 projects

mlx-turboquant

Last released

TurboQuant data-oblivious rotation quantization for MLX-LM, with custom Metal kernels.

kvboost

Last released

Chunk-level KV cache reuse for faster HuggingFace inference

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page