8 projects
bentoml
BentoML: Build Production-Grade AI Applications
openllm-core
OpenLLM Core: Core components for OpenLLM.
openllm-client
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
openllm
OpenLLM: Operating LLMs in production
bentoml-core
The rust core of BentoML: The Unified Model Serving Framework
open-llm-server
whispercpp
bentoml-plugins-arize
BentoML Monitoring Arize Plugin