6 projects
llm-infer
A readable LLM inference server implementing paged attention and continuous batching
appinfra
Infrastructure framework for Python applications
llm-saia
Framework-agnostic verb vocabulary for LLM agents
llm-gent
Agent framework with learning capabilities
llm-kelt
Framework for collecting and managing LLM context
llm-works
LLM utilities and tools
