Last released Sep 4, 2026
Offline and online benchmarking utilities for large language model workloads
Last released Aug 5, 2026
Generate Shenron docker-compose deployments from model config files
Last released Feb 23, 2026
SGLang multiplexer with an OpenAI-compatible frontend