Avatar for Weishu Deng from gravatar.com

Weishu Deng

Username    deng451e
Date joined   Joined

2 projects

lmcache

Last released

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

lmcache-cli

Last released

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page