5 projects
llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes
vagx
Serverless platform for LLMs
vagr
Serverless platform for LLMs
omnistore
An unified python client to communicate with various kinds of object-store providers.
llmlite
A library helps to chat with all kinds of LLMs consistently.
