Last released Nov 27, 2023
libLLM is an open-source project tailored for efficient inference of large language models (LLMs).
Supported by
