Avatar for Cong Chen from gravatar.com

Cong Chen

Username    cong_meta
Date joined   Joined

1 project

vllm-router

Last released

High-performance Rust-based load balancer for VLLM with multiple routing algorithms and prefill-decode disaggregation support
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page