Skip to main content

LiteLLM router-based LLM provider for AgentForge — 100+ underlying providers through one interface

Project description

agentforge-litellm

LiteLLM router-based LLM provider for AgentForge.

Wraps LiteLLM's unified interface so a single AgentForge agent can route to 100+ underlying providers (OpenAI, Anthropic, Bedrock, Vertex, Azure, Mistral, Groq, Fireworks, Together, ...) by changing the model string — no per-provider sister package needed.

When to use this vs. a native sister package:

  • Prefer native (agentforge-anthropic, agentforge-openai, ...) for production paths where you want first-class capability surface (caching, thinking, streaming with full type-checked stream events).
  • Use LiteLLM as a unified gateway, for tail providers AgentForge doesn't ship native packages for yet, or to experiment with new models behind a single config.

Install

pip install "agentforge-litellm[litellm]"

Use

from agentforge import Agent

# Model string is "litellm:<litellm-model-string>". The second
# half is whatever LiteLLM accepts.
agent = Agent(model="litellm:gpt-4o-mini")
agent = Agent(model="litellm:anthropic/claude-sonnet-4-7")
agent = Agent(model="litellm:bedrock/anthropic.claude-sonnet-4-7")

Capabilities

{"tools"} only. LiteLLM normalises tools across underlying providers but doesn't expose a uniform caching / thinking / vision / streaming surface — those vary per backend. If you need those, use the matching native sister package.

License

Apache-2.0. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_litellm-0.2.4.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_litellm-0.2.4-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_litellm-0.2.4.tar.gz.

File metadata

  • Download URL: agentforge_litellm-0.2.4.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentforge_litellm-0.2.4.tar.gz
Algorithm Hash digest
SHA256 d240d51553172921ce9539548902bc52e24cc11036f2b9fe35555c5e15340fe4
MD5 b819e3ab2191b52a15607119761a68b9
BLAKE2b-256 f471b23ff49c18ece96078f1d9149651e0e9bf9092bd63f2ea93c9bf21174890

See more details on using hashes here.

File details

Details for the file agentforge_litellm-0.2.4-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_litellm-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 d0b7ad2bb4b85b0b53bec5221585e022c8b54886ad97afa536cbe72714a760e1
MD5 5f1a975c1359e11d79893af4b6ae3a20
BLAKE2b-256 6c114eb25bd48204e2af2354adbadc486d0f4d4b99c1c4b6ddd479a0533ec7a6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page