Avatar for Rui from gravatar.com

Rui

Username    KingVec
Date joined   Joined

1 project

vllm-hi

Last released

Low-downtime hot migration for vLLM inference services, via monkey-patching and a plugin (no vLLM source changes).
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page