Last released Sep 25, 2024
SGLang is yet another fast serving framework for large language models and vision language models.
Last released Feb 11, 2024
An open platform for training, serving, and evaluating large language model based chatbots.
Supported by