Last released Oct 21, 2025
A FastAPI-based load balancer for vLLM servers with OpenAI-compatible API
Supported by
