3 projects
sglang
SGLang is yet another fast serving framework for large language models and vision language models.
sglang-router
SGLang router is a standalone module implemented in Rust to achieve data parallelism across SGLang instances.
fschat
An open platform for training, serving, and evaluating large language model based chatbots.
