Pre-release

This release is a pre-release and may not be stable for production use.

🚅 LiteLLM

LiteLLM AI Gateway

Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.

LiteLLM Proxy Server (AI Gateway) | Hosted Proxy | Enterprise Tier | Website

What is LiteLLM

LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.

Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.

Jump to LiteLLM Proxy (LLM Gateway) Docs
Jump to Supported LLM Providers

Why LiteLLM

Managing LLM calls across providers gets complicated fast — different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:

Unified API — one interface for 100+ LLMs, no provider-specific SDK juggling
Drop-in OpenAI compatibility — swap providers without rewriting your code
Production-ready gateway — virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box
8ms P95 latency at 1k RPS (benchmarks)

OSS Adopters

Netflix

Features

LLMs - Call 100+ LLMs (Python SDK + AI Gateway)

All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.

Python SDK

uv add litellm

from litellm import completion
import os

os.environ["OPENAI_API_KEY"] = "your-openai-key"
os.environ["ANTHROPIC_API_KEY"] = "your-anthropic-key"

# OpenAI
response = completion(model="openai/gpt-4o", messages=[{"role": "user", "content": "Hello!"}])

# Anthropic  
response = completion(model="anthropic/claude-sonnet-4-20250514", messages=[{"role": "user", "content": "Hello!"}])

AI Gateway (Proxy Server)

Getting Started - E2E Tutorial - Setup virtual keys, make your first request

uv tool install 'litellm[proxy]'
litellm --model gpt-4o

import openai

client = openai.OpenAI(api_key="anything", base_url="http://0.0.0.0:4000")
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}]
)

Docs: LLM Providers

Agents - Invoke A2A Agents (Python SDK + AI Gateway)

Supported Providers - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI

Python SDK - A2A Protocol

from litellm.a2a_protocol import A2AClient
from a2a.types import SendMessageRequest, MessageSendParams
from uuid import uuid4

client = A2AClient(base_url="http://localhost:10001")

request = SendMessageRequest(
    id=str(uuid4()),
    params=MessageSendParams(
        message={
            "role": "user",
            "parts": [{"kind": "text", "text": "Hello!"}],
            "messageId": uuid4().hex,
        }
    )
)
response = await client.send_message(request)

AI Gateway (Proxy Server)

Step 1. Add your Agent to the AI Gateway — set protocolVersion to 1.0 or 0.3 per agent

Step 2. Call Agent via A2A SDK (requires a2a-sdk>=1.1.0)

import httpx
from a2a.client import A2ACardResolver, ClientConfig, ClientFactory
from a2a.types import Message, Part, Role, SendMessageRequest
from a2a.utils.constants import TransportProtocol
from uuid import uuid4

base_url = "http://localhost:4000/a2a/my-agent"  # LiteLLM proxy + agent name
headers = {"Authorization": "Bearer sk-1234"}    # LiteLLM Virtual Key

async with httpx.AsyncClient(headers=headers, timeout=60.0) as http_client:
    resolver = A2ACardResolver(httpx_client=http_client, base_url=base_url)
    agent_card = await resolver.get_agent_card()
    config = ClientConfig(
        httpx_client=http_client,
        streaming=False,
        supported_protocol_bindings=[TransportProtocol.JSONRPC, TransportProtocol.HTTP_JSON],
    )
    client = ClientFactory(config).create(agent_card)

    request = SendMessageRequest(
        message=Message(
            message_id=uuid4().hex,
            role=Role.ROLE_USER,
            parts=[Part(text="Hello!")],
        )
    )
    async for event in client.send_message(request):
        populated = event.ListFields()
        if populated and populated[0][0].name in ("message", "msg"):
            print("".join(getattr(p, "text", "") or "" for p in populated[0][1].parts))

Docs: A2A Agent Gateway

MCP Tools - Connect MCP servers to any LLM (Python SDK + AI Gateway)

Python SDK - MCP Bridge

from mcp import ClientSession, StdioServerParameters
from mcp.client.stdio import stdio_client
from litellm import experimental_mcp_client
import litellm

server_params = StdioServerParameters(command="python", args=["mcp_server.py"])

async with stdio_client(server_params) as (read, write):
    async with ClientSession(read, write) as session:
        await session.initialize()

        # Load MCP tools in OpenAI format
        tools = await experimental_mcp_client.load_mcp_tools(session=session, format="openai")

        # Use with any LiteLLM model
        response = await litellm.acompletion(
            model="gpt-4o",
            messages=[{"role": "user", "content": "What's 3 + 5?"}],
            tools=tools
        )

AI Gateway - MCP Gateway

Step 1. Add your MCP Server to the AI Gateway

Step 2. Call MCP tools via /chat/completions

curl -X POST 'http://0.0.0.0:4000/v1/chat/completions' \
  -H 'Authorization: Bearer sk-1234' \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "gpt-4o",
    "messages": [{"role": "user", "content": "Summarize the latest open PR"}],
    "tools": [{
      "type": "mcp",
      "server_url": "litellm_proxy/mcp/github",
      "server_label": "github_mcp",
      "require_approval": "never"
    }]
  }'

Use with Cursor IDE

{
  "mcpServers": {
    "LiteLLM": {
      "url": "http://localhost:4000/mcp/",
      "headers": {
        "x-litellm-api-key": "Bearer sk-1234"
      }
    }
  }
}

Docs: MCP Gateway

Supported Providers (Website Supported Models | Docs)

Provider	`/chat/completions`	`/messages`	`/responses`	`/embeddings`	`/image/generations`	`/audio/transcriptions`	`/audio/speech`	`/moderations`	`/batches`	`/rerank`
Abliteration (`abliteration`)	✅
AI/ML API (`aiml`)	✅	✅	✅	✅	✅
AI21 (`ai21`)	✅	✅	✅
AI21 Chat (`ai21_chat`)	✅	✅	✅
Aleph Alpha	✅	✅	✅
Amazon Nova	✅	✅	✅
Anthropic (`anthropic`)	✅	✅	✅						✅
Anthropic Text (`anthropic_text`)	✅	✅	✅						✅
Anyscale	✅	✅	✅
AssemblyAI (`assemblyai`)	✅	✅	✅			✅
Auto Router (`auto_router`)	✅	✅	✅
AWS - Bedrock (`bedrock`)	✅	✅	✅	✅						✅
AWS - Sagemaker (`sagemaker`)	✅	✅	✅	✅
Azure (`azure`)	✅	✅	✅	✅	✅	✅	✅	✅	✅
Azure AI (`azure_ai`)	✅	✅	✅	✅	✅	✅	✅	✅	✅
Azure Text (`azure_text`)	✅	✅	✅			✅	✅	✅	✅
Baseten (`baseten`)	✅	✅	✅
Bytez (`bytez`)	✅	✅	✅
Cerebras (`cerebras`)	✅	✅	✅
Clarifai (`clarifai`)	✅	✅	✅
Cloudflare AI Workers (`cloudflare`)	✅	✅	✅
Codestral (`codestral`)	✅	✅	✅
Cohere (`cohere`)	✅	✅	✅	✅						✅
Cohere Chat (`cohere_chat`)	✅	✅	✅
CometAPI (`cometapi`)	✅	✅	✅	✅
CompactifAI (`compactifai`)	✅	✅	✅
Custom (`custom`)	✅	✅	✅
Custom OpenAI (`custom_openai`)	✅	✅	✅			✅	✅	✅	✅
Dashscope (`dashscope`)	✅	✅	✅	✅						✅
Databricks (`databricks`)	✅	✅	✅
DataRobot (`datarobot`)	✅	✅	✅
Deepgram (`deepgram`)	✅	✅	✅			✅
DeepInfra (`deepinfra`)	✅	✅	✅
Deepseek (`deepseek`)	✅	✅	✅
ElevenLabs (`elevenlabs`)	✅	✅	✅			✅	✅
Empower (`empower`)	✅	✅	✅
Fal AI (`fal_ai`)	✅	✅	✅		✅
Featherless AI (`featherless_ai`)	✅	✅	✅
Fireworks AI (`fireworks_ai`)	✅	✅	✅
FriendliAI (`friendliai`)	✅	✅	✅
Galadriel (`galadriel`)	✅	✅	✅
GitHub Copilot (`github_copilot`)	✅	✅	✅	✅
GitHub Models (`github`)	✅	✅	✅
Google - PaLM	✅	✅	✅
Google - Vertex AI (`vertex_ai`)	✅	✅	✅	✅	✅
Google AI Studio - Gemini (`gemini`)	✅	✅	✅
GradientAI (`gradient_ai`)	✅	✅	✅
Groq AI (`groq`)	✅	✅	✅
Heroku (`heroku`)	✅	✅	✅
Hosted VLLM (`hosted_vllm`)	✅	✅	✅
Huggingface (`huggingface`)	✅	✅	✅	✅						✅
Hyperbolic (`hyperbolic`)	✅	✅	✅
IBM - Watsonx.ai (`watsonx`)	✅	✅	✅	✅
Infinity (`infinity`)				✅
Jina AI (`jina_ai`)				✅
Lambda AI (`lambda_ai`)	✅	✅	✅
Lemonade (`lemonade`)	✅	✅	✅
LiteLLM Proxy (`litellm_proxy`)	✅	✅	✅	✅	✅
Llamafile (`llamafile`)	✅	✅	✅
LM Studio (`lm_studio`)	✅	✅	✅
Maritalk (`maritalk`)	✅	✅	✅
Meta - Llama API (`meta_llama`)	✅	✅	✅
Mistral AI API (`mistral`)	✅	✅	✅	✅
ModelScope (`modelscope`)	✅	✅	✅		✅
Moonshot (`moonshot`)	✅	✅	✅
Morph (`morph`)	✅	✅	✅
Nebius AI Studio (`nebius`)	✅	✅	✅	✅
NLP Cloud (`nlp_cloud`)	✅	✅	✅
Novita AI (`novita`)	✅	✅	✅
Nscale (`nscale`)	✅	✅	✅
Nvidia NIM (`nvidia_nim`)	✅	✅	✅
OCI (`oci`)	✅	✅	✅
Ollama (`ollama`)	✅	✅	✅	✅
Ollama Chat (`ollama_chat`)	✅	✅	✅
Oobabooga (`oobabooga`)	✅	✅	✅			✅	✅	✅	✅
OpenAI (`openai`)	✅	✅	✅	✅	✅	✅	✅	✅	✅
OpenAI-like (`openai_like`)				✅
OpenRouter (`openrouter`)	✅	✅	✅
OVHCloud AI Endpoints (`ovhcloud`)	✅	✅	✅
Perplexity AI (`perplexity`)	✅	✅	✅
Petals (`petals`)	✅	✅	✅
Pinstripes (`pinstripes`)	✅	✅	✅
Predibase (`predibase`)	✅	✅	✅
Recraft (`recraft`)					✅
Replicate (`replicate`)	✅	✅	✅
Sagemaker Chat (`sagemaker_chat`)	✅	✅	✅
Sambanova (`sambanova`)	✅	✅	✅
Snowflake (`snowflake`)	✅	✅	✅
Text Completion Codestral (`text-completion-codestral`)	✅	✅	✅
Text Completion OpenAI (`text-completion-openai`)	✅	✅	✅			✅	✅	✅	✅
Together AI (`together_ai`)	✅	✅	✅
Topaz (`topaz`)	✅	✅	✅
Triton (`triton`)	✅	✅	✅
V0 (`v0`)	✅	✅	✅
Vercel AI Gateway (`vercel_ai_gateway`)	✅	✅	✅
VLLM (`vllm`)	✅	✅	✅
Volcengine (`volcengine`)	✅	✅	✅
Voyage AI (`voyage`)				✅
WandB Inference (`wandb`)	✅	✅	✅
Watsonx Text (`watsonx_text`)	✅	✅	✅
xAI (`xai`)	✅	✅	✅
Xinference (`xinference`)				✅

Read the Docs

Get Started

You can use LiteLLM through either the Proxy Server or Python SDK. Both give you a unified interface to access multiple LLMs (100+ LLMs). Choose the option that best fits your needs:

	LiteLLM AI Gateway	LiteLLM Python SDK
Use Case	Central service (LLM Gateway) to access multiple LLMs	Use LiteLLM directly in your Python code
Who Uses It?	Gen AI Enablement / ML Platform Teams	Developers building LLM projects
Key Features	Centralized API gateway with authentication and authorization, multi-tenant cost tracking and spend management per project/user, per-project customization (logging, guardrails, caching), virtual keys for secure access control, admin dashboard UI for monitoring and management	Direct Python library integration in your codebase, Router with retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router, application-level load balancing and cost tracking, exception handling with OpenAI-compatible errors, observability callbacks (Lunary, MLflow, Langfuse, etc.)

Stable Release: Use docker images with the -stable tag. These have undergone 12 hour load tests, before being published. More information about the release cycle here

Support for more providers. Missing a provider or LLM Platform, raise a feature request.

Deploy on AWS or GCP with Terraform

Run the LiteLLM proxy as a production-ready componentized stack (gateway, backend, UI on separate services; managed Postgres + Redis + object store) using the published Terraform modules. Both modules are on the public Terraform Registry — no auth needed.

AWS — ECS Fargate + Aurora + ElastiCache + ALB

— opens an in-browser shell, already authenticated to your AWS account. Once inside, run:

git clone https://github.com/BerriAI/litellm.git
cd litellm/terraform/litellm/aws/examples/default
cp terraform.tfvars.example terraform.tfvars   # edit region/tenant/env
terraform init && terraform apply

Module page →

Or call the module from your own root config:

# main.tf
terraform {
  required_version = ">= 1.6.0"
  required_providers {
    aws = { source = "hashicorp/aws", version = "~> 5.60" }
  }
}

provider "aws" {
  region = "us-west-2"
}

module "litellm" {
  source  = "BerriAI/litellm/aws"
  version = "~> 1.89"

  region = "us-west-2"
  azs    = ["us-west-2a", "us-west-2b"]
  tenant = "acme"
  env    = "prod"

  # Production: provide an ACM cert. Without one, set allow_plaintext_alb = true
  # (dev/trial only).
  # acm_certificate_arn = "arn:aws:acm:us-west-2:111122223333:certificate/..."
  allow_plaintext_alb = true
}

output "litellm_url" {
  value = module.litellm.alb_dns_name
}

terraform init
terraform apply

Provider API keys live in AWS Secrets Manager; reference ARNs via gateway_extra_secrets. Full input list and architecture diagram on the registry page.

GCP — Cloud Run + Cloud SQL + Memorystore + HTTPS LB

Real 1-click. Opens Cloud Shell, clones this repo, and walks you through terraform apply via a built-in DeployStack tutorial — pick the project, the tutorial sets up the Artifact Registry remote repo, writes terraform.tfvars from your answers, and runs apply.

Module page →

To call the module from your own config instead, Cloud Run can't pull from ghcr.io directly, so first set up a one-time Artifact Registry remote repo backed by GHCR:

gcloud artifacts repositories create litellm \
  --location=us-central1 \
  --repository-format=docker \
  --mode=remote-repository \
  --remote-docker-repo=https://ghcr.io \
  --project=my-gcp-project

Then:

# main.tf
terraform {
  required_version = ">= 1.6.0"
  required_providers {
    google      = { source = "hashicorp/google",      version = "~> 6.10" }
    google-beta = { source = "hashicorp/google-beta", version = "~> 6.10" }
  }
}

provider "google"      { project = "my-gcp-project"; region = "us-central1" }
provider "google-beta" { project = "my-gcp-project"; region = "us-central1" }

module "litellm" {
  source  = "BerriAI/litellm/google"
  version = "~> 1.89"

  project_id = "my-gcp-project"
  region     = "us-central1"
  tenant     = "acme"
  env        = "prod"

  # Replace my-gcp-project with your GCP project ID (same value as project_id above).
  image_registry = "us-central1-docker.pkg.dev/my-gcp-project/litellm/berriai"

  # Production: provide DNS already pointing at the LB IP for Google-managed certs.
  # Without one, set allow_plaintext_lb = true (dev/trial only).
  # lb_domains         = ["proxy.example.com"]
  allow_plaintext_lb = true
}

output "litellm_url" {
  value = module.litellm.load_balancer_url
}

terraform init
terraform apply

Provider API keys live in Secret Manager; reference resource IDs (e.g. projects/my-gcp-project/secrets/openai-api-key) via gateway_extra_secrets. Full input list and architecture diagram on the registry page.

Both stacks include

The full componentized split (gateway / backend / UI as independent services)
Managed Postgres (writer + reader) and Redis
Versioned object store for proxy state + file uploads
An auto-generated LITELLM_MASTER_KEY in your cloud's secret manager
A one-off migration job that runs prisma migrate deploy before the proxy starts
The same proxy_config surface as the Helm chart — pass YAML as a typed map

The Terraform modules live at terraform/litellm/aws/ and terraform/litellm/gcp/ in this repo; the registry entries are read-only mirrors updated on each release.

Run in Developer Mode

Services

Setup .env file in root
Run dependent services docker-compose up db prometheus

Backend

Run make bootstrap
Start proxy backend: uv run python litellm/proxy/proxy_cli.py

Frontend

Navigate to ui/litellm-dashboard (dependencies were already installed w/ make bootstrap)
Start dashboard: npm run dev

Verify Docker Image Signatures

All LiteLLM Docker images published to GHCR are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:<release-tag>

Verify using a release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/<release-tag>/cosign.pub \
  ghcr.io/berriai/litellm:<release-tag>

Replace <release-tag> with the version you are deploying (e.g. v1.83.0-stable).

Enterprise

For companies that need better security, user management and professional support

Get an Enterprise License Talk to founders

This covers:

✅ Features under the LiteLLM Commercial License:
✅ Feature Prioritization
✅ Custom Integrations
✅ Professional Support - Dedicated discord + slack
✅ Custom SLAs
✅ Secure access with Single Sign-On

Contributing

We welcome contributions to LiteLLM! Whether you're fixing bugs, adding features, or improving documentation, we appreciate your help.

Quick Start for Contributors

This requires uv to be installed.

git clone https://github.com/BerriAI/litellm.git
cd litellm
make install-dev    # Install development dependencies
make format         # Format your code
make lint           # Run all linting checks
make test-unit      # Run unit tests
make format-check   # Check formatting only

For detailed contributing guidelines, see CONTRIBUTING.md.

📖 Contributing to documentation? The LiteLLM docs have moved to a separate repository: BerriAI/litellm-docs. Please open doc PRs there. Docs are served at docs.litellm.ai.

Code Quality / Linting

LiteLLM follows the Google Python Style Guide.

Our automated checks include:

Black for code formatting
Ruff for linting and code quality
MyPy for type checking
Circular import detection
Import safety checks

All these checks must pass before your PR can be merged.

Support / talk with founders

Schedule Demo 👋
Community Discord 💭
Community Slack 💭
Our emails ✉️ ishaan@berri.ai / krrish@berri.ai

Contributors

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

litellm_dev-1.97.0.dev4.tar.gz (17.7 MB view details)

Uploaded Aug 7, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

litellm_dev-1.97.0.dev4-cp314-cp314-win_amd64.whl (25.1 MB view details)

Uploaded Aug 7, 2026 CPython 3.14Windows x86-64

litellm_dev-1.97.0.dev4-cp314-cp314-musllinux_1_2_x86_64.whl (26.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.14musllinux: musl 1.2+ x86-64

litellm_dev-1.97.0.dev4-cp314-cp314-musllinux_1_2_aarch64.whl (26.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.14musllinux: musl 1.2+ ARM64

litellm_dev-1.97.0.dev4-cp314-cp314-manylinux_2_28_x86_64.whl (26.5 MB view details)

Uploaded Aug 7, 2026 CPython 3.14manylinux: glibc 2.28+ x86-64

litellm_dev-1.97.0.dev4-cp314-cp314-manylinux_2_28_aarch64.whl (26.6 MB view details)

Uploaded Aug 7, 2026 CPython 3.14manylinux: glibc 2.28+ ARM64

litellm_dev-1.97.0.dev4-cp314-cp314-macosx_11_0_arm64.whl (25.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.14macOS 11.0+ ARM64

litellm_dev-1.97.0.dev4-cp314-cp314-macosx_10_12_x86_64.whl (25.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.14macOS 10.12+ x86-64

litellm_dev-1.97.0.dev4-cp313-cp313-win_amd64.whl (25.1 MB view details)

Uploaded Aug 7, 2026 CPython 3.13Windows x86-64

litellm_dev-1.97.0.dev4-cp313-cp313-musllinux_1_2_x86_64.whl (26.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.13musllinux: musl 1.2+ x86-64

litellm_dev-1.97.0.dev4-cp313-cp313-musllinux_1_2_aarch64.whl (26.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.13musllinux: musl 1.2+ ARM64

litellm_dev-1.97.0.dev4-cp313-cp313-manylinux_2_28_x86_64.whl (26.5 MB view details)

Uploaded Aug 7, 2026 CPython 3.13manylinux: glibc 2.28+ x86-64

litellm_dev-1.97.0.dev4-cp313-cp313-manylinux_2_28_aarch64.whl (26.6 MB view details)

Uploaded Aug 7, 2026 CPython 3.13manylinux: glibc 2.28+ ARM64

litellm_dev-1.97.0.dev4-cp313-cp313-macosx_11_0_arm64.whl (25.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.13macOS 11.0+ ARM64

litellm_dev-1.97.0.dev4-cp313-cp313-macosx_10_12_x86_64.whl (25.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.13macOS 10.12+ x86-64

litellm_dev-1.97.0.dev4-cp312-cp312-win_amd64.whl (25.1 MB view details)

Uploaded Aug 7, 2026 CPython 3.12Windows x86-64

litellm_dev-1.97.0.dev4-cp312-cp312-musllinux_1_2_x86_64.whl (26.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.12musllinux: musl 1.2+ x86-64

litellm_dev-1.97.0.dev4-cp312-cp312-musllinux_1_2_aarch64.whl (26.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.12musllinux: musl 1.2+ ARM64

litellm_dev-1.97.0.dev4-cp312-cp312-manylinux_2_28_x86_64.whl (26.5 MB view details)

Uploaded Aug 7, 2026 CPython 3.12manylinux: glibc 2.28+ x86-64

litellm_dev-1.97.0.dev4-cp312-cp312-manylinux_2_28_aarch64.whl (26.6 MB view details)

Uploaded Aug 7, 2026 CPython 3.12manylinux: glibc 2.28+ ARM64

litellm_dev-1.97.0.dev4-cp312-cp312-macosx_11_0_arm64.whl (25.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.12macOS 11.0+ ARM64

litellm_dev-1.97.0.dev4-cp312-cp312-macosx_10_12_x86_64.whl (25.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.12macOS 10.12+ x86-64

litellm_dev-1.97.0.dev4-cp311-cp311-win_amd64.whl (25.1 MB view details)

Uploaded Aug 7, 2026 CPython 3.11Windows x86-64

litellm_dev-1.97.0.dev4-cp311-cp311-musllinux_1_2_x86_64.whl (26.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.11musllinux: musl 1.2+ x86-64

litellm_dev-1.97.0.dev4-cp311-cp311-musllinux_1_2_aarch64.whl (26.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.11musllinux: musl 1.2+ ARM64

litellm_dev-1.97.0.dev4-cp311-cp311-manylinux_2_28_x86_64.whl (26.5 MB view details)

Uploaded Aug 7, 2026 CPython 3.11manylinux: glibc 2.28+ x86-64

litellm_dev-1.97.0.dev4-cp311-cp311-manylinux_2_28_aarch64.whl (26.6 MB view details)

Uploaded Aug 7, 2026 CPython 3.11manylinux: glibc 2.28+ ARM64

litellm_dev-1.97.0.dev4-cp311-cp311-macosx_11_0_arm64.whl (25.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.11macOS 11.0+ ARM64

litellm_dev-1.97.0.dev4-cp311-cp311-macosx_10_12_x86_64.whl (25.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.11macOS 10.12+ x86-64

litellm_dev-1.97.0.dev4-cp310-cp310-win_amd64.whl (25.1 MB view details)

Uploaded Aug 7, 2026 CPython 3.10Windows x86-64

litellm_dev-1.97.0.dev4-cp310-cp310-musllinux_1_2_x86_64.whl (26.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.10musllinux: musl 1.2+ x86-64

litellm_dev-1.97.0.dev4-cp310-cp310-musllinux_1_2_aarch64.whl (26.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.10musllinux: musl 1.2+ ARM64

litellm_dev-1.97.0.dev4-cp310-cp310-manylinux_2_28_x86_64.whl (26.5 MB view details)

Uploaded Aug 7, 2026 CPython 3.10manylinux: glibc 2.28+ x86-64

litellm_dev-1.97.0.dev4-cp310-cp310-manylinux_2_28_aarch64.whl (26.6 MB view details)

Uploaded Aug 7, 2026 CPython 3.10manylinux: glibc 2.28+ ARM64

litellm_dev-1.97.0.dev4-cp310-cp310-macosx_11_0_arm64.whl (25.7 MB view details)

Uploaded Aug 7, 2026 CPython 3.10macOS 11.0+ ARM64

litellm_dev-1.97.0.dev4-cp310-cp310-macosx_10_12_x86_64.whl (25.9 MB view details)

Uploaded Aug 7, 2026 CPython 3.10macOS 10.12+ x86-64

File details

Details for the file litellm_dev-1.97.0.dev4.tar.gz.

File metadata

Download URL: litellm_dev-1.97.0.dev4.tar.gz
Upload date: Aug 7, 2026
Size: 17.7 MB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm_dev-1.97.0.dev4.tar.gz
Algorithm	Hash digest
SHA256	`c6119248f90deecb3531fdf320f14c7a335e3f80a1d581c17c2440abf389744d`
MD5	`37fc8a973365720bbf291803c32c0a05`
BLAKE2b-256	`71a412f60f38cb06f5c5aecc6d5d29627c91493d743202aa686acfe893494f88`

Algorithm	Hash digest
SHA256	`b583f8f62ac9b420e06513b42f2b28b00c6d12b7cba8de15f3e85665d65c8465`
MD5	`9e2ca95bf6caacce6876dd3a31d524a2`
BLAKE2b-256	`5da9cd40eb99e029e1686f23ec124458380de63ec2d9b8057a06768be8a3e016`

Algorithm	Hash digest
SHA256	`a2598131753ff0e3201464874bc3c92d02cddadf261fc5b482c8dd57eb4b50ef`
MD5	`3aa6a33ff16b53b2cda5d86ed3961069`
BLAKE2b-256	`62cfc33f9230cc88d7cc14b7ce01afabfce68b40ac662f162e874f04c56d5c91`

Algorithm	Hash digest
SHA256	`d9f80aca9a9cacd0715d3653d963ce4a5b16eaf2eda52d4a982ea0a338b6b8e3`
MD5	`9af3f830c6cab91554f57453f35c8800`
BLAKE2b-256	`1cbc6dcd0934a4047a4dfe9763adc561c825dac6f3be9bb65bdc904f9276e0d2`

Algorithm	Hash digest
SHA256	`213f054b17728fbc89e86675db1919acddfd2699f0411d7996942b78b309222d`
MD5	`2179e3674766b27eaa63a649da2838dd`
BLAKE2b-256	`8b8a1f56bbc50d3bd82915bd892a73387a57e61b9df11b49d4e7c4cc42613621`

Algorithm	Hash digest
SHA256	`3ea55de3ad2fb505e086cb07baf28f8c9fed42069ef4f713f41ca7db4ecb0449`
MD5	`9c62bea0c9959959225aa15dc3d8c072`
BLAKE2b-256	`9f05ee79791e9a5ca7d2551a51a87885fabdbe47ba1122c24a5d1b5923af17d5`

Algorithm	Hash digest
SHA256	`9a8bc30b114d31cf114009136386610653d0c867dec092ac986a62069657a967`
MD5	`e78f7376b4bf313dab2ec2ba28acd611`
BLAKE2b-256	`044cf59e97ca51c9787f86a1112e7bf840b1e4dc1aad8c3c367e5d18708e74cf`

Algorithm	Hash digest
SHA256	`552e83f950f144dc8b7dabc614d156258aeec4062758de874a5a0e3cb75956a1`
MD5	`df4b0c63d39f923f6327b952945d21f1`
BLAKE2b-256	`13a6e72cfe62a6e6b882d5914ee24faa379b932bca1497bfc6d3dcc8be9057b6`

Algorithm	Hash digest
SHA256	`7ab4dc8cd6133d9ad3ad39d70cc4018276a541cbdf49b3d8af9f74cff1e060c7`
MD5	`d47c1c57f292f5a9e96a1666c6885ec7`
BLAKE2b-256	`77b12e404f5c332f6e7f56e813fae7978b729b6b534613652ec834ae5afee2ae`

Algorithm	Hash digest
SHA256	`69674a8accd10cb5a3a5303eb49523e779725a813ea30514d10d7aa0b1c6a173`
MD5	`c700b3f0b591051c2fb418b29b413114`
BLAKE2b-256	`b8961c45c0c33208df72d50a9653a582c6300fe53d1ced21f56ed85830aa3d9d`

Algorithm	Hash digest
SHA256	`99e7ebafdccb94b779cbe871b28de2c5314652c9873c9629eb243705eaf09e41`
MD5	`e1b4868f8ca2d4c6be131857a5754e97`
BLAKE2b-256	`a66a2a037f3f42642b0fc1897c0750b97153703d9438fbfc0652709c09b9ecd8`

Algorithm	Hash digest
SHA256	`6f35d31ebac68887881dce5ee0cae6a1e6c27cc13b06a8473ba8e6d86e2cd810`
MD5	`37fc667f1ec7c859b2f708aecd00e1d8`
BLAKE2b-256	`ca9a7bade2cfa44010ac0798274624570f67b90e49516a659f927e4db048edeb`

Algorithm	Hash digest
SHA256	`6b6d3e1c7215b992de8eacc4e2459a1ca07fb83a3fbe90528d2da0a3b397c662`
MD5	`4ac6756251275ba5ae645727db3afc68`
BLAKE2b-256	`94cfc959edcaee29191e6e754b2d47b08c028e66ffca1d003036217eb0d5bc6e`

Algorithm	Hash digest
SHA256	`ca7799158a87a14547c6f87d610e5d378c346e88fe21ce69e94a075eb034bfc3`
MD5	`5517469296aa0654429fa70afc4ffe19`
BLAKE2b-256	`94ec48ba5e7be00c00c4edc8aaaeb8d93936bd53591a1ba4e953500c4a3150b3`

Algorithm	Hash digest
SHA256	`16059ed74cfb2beac72148824743689f605a779cb3ac14649f5f08f1db8542ea`
MD5	`3de02b7e3849dc091ff9577d0cbf893f`
BLAKE2b-256	`ab7c7960ab8bad5f25158713ae267f68040ad1038495f5d710f90b3c4b65b352`

Algorithm	Hash digest
SHA256	`0aee818aec7ec36d70c4402129c4ca26579f52859ee297c5bcf62aac8aa25316`
MD5	`76528c7aae613434e0ee9b024c751631`
BLAKE2b-256	`887dab6e3a641619dafb25175d9fa9cb73f67ad7cb3e5f0e603466a08565d322`

Algorithm	Hash digest
SHA256	`10037725b1395bb4961dd954d1e29062197b6bf10cba37675cd4a4c37aff4cb7`
MD5	`36dd4dcdda60d2bcd87435d47ad4005f`
BLAKE2b-256	`8ada8ebf73b9f1f57a7b2ed754af4cbffa6a986983999c48a4e4a6a95b8743f8`

Algorithm	Hash digest
SHA256	`b7fea81a90575f86143e6997a5f36f41846a9487427d3f81b84b78424d7e39c1`
MD5	`ca85056a8e4a5e5cba0ded4cfdc9d3bb`
BLAKE2b-256	`064386eebc0bef0a67e80117461d14b46ecc1bd6b73e73e464bf7e4ad11e449f`

Algorithm	Hash digest
SHA256	`2b6b9bddc8130dee4b00b9390752c018de8ed2979bf9ce73ee61cd0d99743deb`
MD5	`5345fbfb1fb5ad8c3ba73f254573b50d`
BLAKE2b-256	`56b0ee799b89612f00a6d8ccc557260cc4fd7be16787f527d9ba2eef270f89fb`

Algorithm	Hash digest
SHA256	`0b7369f4be671f9c8c7a201bc77f06690ab1c9b8d88e56d98d9b3117859dd235`
MD5	`767ef199c61cb55418f55df4675da1e7`
BLAKE2b-256	`bace929b408efb25dea698f5a14b1aaaa5d8f0712160cc6c4042d02b92a89b13`

Algorithm	Hash digest
SHA256	`b79f0faaea3284d96f22651d83a8a1e8b0cd4bc793594a863ce3421b6bce4559`
MD5	`2917be053886027ae208c5688b4c63f6`
BLAKE2b-256	`e8c15678b59d4fb12ad735fbe9125badde105ccaedc142bcc36a218eaa0eada9`

litellm-dev 1.97.0.dev4

🚅 LiteLLM

LiteLLM Proxy Server (AI Gateway) | Hosted Proxy | Enterprise Tier | Website

What is LiteLLM

Why LiteLLM

OSS Adopters

Netflix

Features

Python SDK

AI Gateway (Proxy Server)

Python SDK - A2A Protocol

AI Gateway (Proxy Server)

Python SDK - MCP Bridge

AI Gateway - MCP Gateway

Use with Cursor IDE

Supported Providers (Website Supported Models | Docs)

Get Started

Deploy on AWS or GCP with Terraform

AWS — ECS Fargate + Aurora + ElastiCache + ALB

GCP — Cloud Run + Cloud SQL + Memorystore + HTTPS LB

Both stacks include

Run in Developer Mode

Services

Backend

Frontend

Verify Docker Image Signatures

Enterprise

Contributing

Quick Start for Contributors

Code Quality / Linting

Support / talk with founders

Contributors

Project links

Key dates

Owner

Credits

License expression

Requires

Provides Extra

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

Algorithm	Hash digest
SHA256	`01b9d58215eeebe238f3ff94adb9b0cacd1dc9e8411021ce3a657f41d45ef3d6`
MD5	`74c7627cfa1e616f425d30ce34362ba5`
BLAKE2b-256	`e16d881900e1d77d3fdeb62786d166def3a787b016ae5d2f477ffcef8913d091`

Algorithm	Hash digest
SHA256	`9d1971c8262e28adeecd58e1a2cc2c0285277508938acd4a7022018066c0201c`
MD5	`8c8c5291633c4c372f8961967cf74569`
BLAKE2b-256	`9c60a110a39cff04861b3fa9775a4beb1d2ae82e85558e446245e539d4f4e2ec`

Algorithm	Hash digest
SHA256	`44f02c9e4d00cac8275b1974cd971a064ad88e80630867eea19c79ea1e01ea83`
MD5	`542e5f5c0a63353f1ca44850fe8d6345`
BLAKE2b-256	`e356f11aec875a9d3b3f73b44a21c3210843f51d656030e7bb11e0ff3beb02d3`

Algorithm	Hash digest
SHA256	`c90462112ef5ff84bf7b085cd1daba7227d62c3634de2c70248836d9a8f857a4`
MD5	`4fc10d970f63b6ec79e6b93e42e4e189`
BLAKE2b-256	`3d9a57e0757040685a69c49130c218968971b73f1fe0a6680d4a1e6028be43dc`

Algorithm	Hash digest
SHA256	`1bcca65e2b44e40483b6e6d30d6c0bd6ffd0366b2e55f57b1db8dff28f683168`
MD5	`08fdbf68aac857aca2c0b0cd492d9a6d`
BLAKE2b-256	`1d762301656afd9f1ead0d939970dae8285983ae1d0ba0384c1049840e5a437f`

Algorithm	Hash digest
SHA256	`493a6cf0354ab712edad04eea261995a73a201a1bbf120e3d805ef4a3835d5f3`
MD5	`c862bb20b9cd3dba7d0432751d4c3ae3`
BLAKE2b-256	`4d27ce5dbfaad3ffce79a81789b379f36ca3ffc44a93a988cb9aa8b186e7e995`

Algorithm	Hash digest
SHA256	`5433787140490eadbd78d6f4652c700bc3a1876a27737db2030485a601f7a15b`
MD5	`282cf35a44f2286de745faece8451231`
BLAKE2b-256	`8afbed016450276a71db5797457d62e640baa2b4dbc2af4b7f29dcc30bd5759d`

Algorithm	Hash digest
SHA256	`c0394dbbf181c071437b57eb1460741e52e40a005f5c226a1ce61693c363a043`
MD5	`fc1bde3faca60653bc893e5f23fc46ca`
BLAKE2b-256	`8fed0e77ac9e35619a84540a307436692713f221027317b9f72c25dabf5d4ec7`

Algorithm	Hash digest
SHA256	`82c01b4e2008770781a44c5d2c97efe963f4470e26ef6cbcabb3136d0597a938`
MD5	`ed9b172cd82b9e8216fafa396d12e6a7`
BLAKE2b-256	`70fffb2c948987b694650b36d72fd2b9f500c140a7254a7bdd7555901e356a0b`

Algorithm	Hash digest
SHA256	`5b546e9a727a741886a127e83a263259a5d6a03caeca94cf9ef287422fefb2a8`
MD5	`ec4eef4e32fece8c93e311d6efe99472`
BLAKE2b-256	`3b99893e485be59ce9940bd8bf87a6ec29429187075942333066df87558748cb`