6 projects
llm-gent
Agent framework with learning capabilities
llm-kelt
Framework for collecting and managing LLM context
llm-infer
Multi-backend LLM client library, a from-scratch PagedAttention inference engine, and an OpenAI-compatible serve wrapper.
appinfra
Infrastructure framework for Python applications
llm-saia
Framework-agnostic verb vocabulary for LLM agents
llm-works
LLM utilities and tools