Last released Apr 24, 2026
High-performance Rust-based load balancer for VLLM with multiple routing algorithms and prefill-decode disaggregation support
Supported by
