Avatar for Shreyan from gravatar.com

Shreyan

Username    shreyan1999
Date joined   Joined

1 project

kvstream

Last released

PagedAttention + continuous batching as a drop-in plugin for local LLM inference

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page