Last released Oct 31, 2026
SGLang is a fast serving framework for large language models and vision language models.
A highly optimized MOE hybrid inference engine for CPU-GPU collaborative execution of large-scale MOE models.