Last released Apr 25, 2024
A high-throughput and memory-efficient inference and serving engine for LLMs
Last released Jan 31, 2024
Prism: An intercloud broker for the clouds
Last released Jan 8, 2024
An open platform for training, serving, and evaluating large language model based chatbots by next ai
Supported by
