Skip to main content

๐Ÿš… LiteLLM

LiteLLM AI Gateway

Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.

Deploy to Render Deploy on Railway Deploy on AWS Deploy on GCP

LiteLLM Proxy Server (AI Gateway) | Hosted Proxy | Enterprise Tier | Website

PyPI Version GitHub Stars Y Combinator W23 Whatsapp Discord Slack CodSpeed

LiteLLM AI Gateway

What is LiteLLM

LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers โ€” OpenAI, Anthropic, Gemini, Bedrock, Azure, and more โ€” using the OpenAI format.

Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.

Jump to LiteLLM Proxy (LLM Gateway) Docs
Jump to Supported LLM Providers


Why LiteLLM

Managing LLM calls across providers gets complicated fast โ€” different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:

  • Unified API โ€” one interface for 100+ LLMs, no provider-specific SDK juggling
  • Drop-in OpenAI compatibility โ€” swap providers without rewriting your code
  • Production-ready gateway โ€” virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box
  • 8ms P95 latency at 1k RPS (benchmarks)

OSS Adopters

Stripe image Google ADK Greptile OpenHands

Netflix

OpenAI Agents SDK

Features

LLMs - Call 100+ LLMs (Python SDK + AI Gateway)

All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.

Python SDK

uv add litellm
from litellm import completion
import os

os.environ["OPENAI_API_KEY"] = "your-openai-key"
os.environ["ANTHROPIC_API_KEY"] = "your-anthropic-key"

# OpenAI
response = completion(model="openai/gpt-4o", messages=[{"role": "user", "content": "Hello!"}])

# Anthropic  
response = completion(model="anthropic/claude-sonnet-4-20250514", messages=[{"role": "user", "content": "Hello!"}])

AI Gateway (Proxy Server)

Getting Started - E2E Tutorial - Setup virtual keys, make your first request

uv tool install 'litellm[proxy]'
litellm --model gpt-4o
import openai

client = openai.OpenAI(api_key="anything", base_url="http://0.0.0.0:4000")
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}]
)

Docs: LLM Providers

Agents - Invoke A2A Agents (Python SDK + AI Gateway)

Supported Providers - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI

Python SDK - A2A Protocol

from litellm.a2a_protocol import A2AClient
from a2a.types import SendMessageRequest, MessageSendParams
from uuid import uuid4

client = A2AClient(base_url="http://localhost:10001")

request = SendMessageRequest(
    id=str(uuid4()),
    params=MessageSendParams(
        message={
            "role": "user",
            "parts": [{"kind": "text", "text": "Hello!"}],
            "messageId": uuid4().hex,
        }
    )
)
response = await client.send_message(request)

AI Gateway (Proxy Server)

Step 1. Add your Agent to the AI Gateway โ€” set protocolVersion to 1.0 or 0.3 per agent

Step 2. Call Agent via A2A SDK (requires a2a-sdk>=1.1.0)

import httpx
from a2a.client import A2ACardResolver, ClientConfig, ClientFactory
from a2a.types import Message, Part, Role, SendMessageRequest
from a2a.utils.constants import TransportProtocol
from uuid import uuid4

base_url = "http://localhost:4000/a2a/my-agent"  # LiteLLM proxy + agent name
headers = {"Authorization": "Bearer sk-1234"}    # LiteLLM Virtual Key

async with httpx.AsyncClient(headers=headers, timeout=60.0) as http_client:
    resolver = A2ACardResolver(httpx_client=http_client, base_url=base_url)
    agent_card = await resolver.get_agent_card()
    config = ClientConfig(
        httpx_client=http_client,
        streaming=False,
        supported_protocol_bindings=[TransportProtocol.JSONRPC, TransportProtocol.HTTP_JSON],
    )
    client = ClientFactory(config).create(agent_card)

    request = SendMessageRequest(
        message=Message(
            message_id=uuid4().hex,
            role=Role.ROLE_USER,
            parts=[Part(text="Hello!")],
        )
    )
    async for event in client.send_message(request):
        populated = event.ListFields()
        if populated and populated[0][0].name in ("message", "msg"):
            print("".join(getattr(p, "text", "") or "" for p in populated[0][1].parts))

Docs: A2A Agent Gateway

MCP Tools - Connect MCP servers to any LLM (Python SDK + AI Gateway)

Python SDK - MCP Bridge

from mcp import ClientSession, StdioServerParameters
from mcp.client.stdio import stdio_client
from litellm import experimental_mcp_client
import litellm

server_params = StdioServerParameters(command="python", args=["mcp_server.py"])

async with stdio_client(server_params) as (read, write):
    async with ClientSession(read, write) as session:
        await session.initialize()

        # Load MCP tools in OpenAI format
        tools = await experimental_mcp_client.load_mcp_tools(session=session, format="openai")

        # Use with any LiteLLM model
        response = await litellm.acompletion(
            model="gpt-4o",
            messages=[{"role": "user", "content": "What's 3 + 5?"}],
            tools=tools
        )

AI Gateway - MCP Gateway

Step 1. Add your MCP Server to the AI Gateway

Step 2. Call MCP tools via /chat/completions

curl -X POST 'http://0.0.0.0:4000/v1/chat/completions' \
  -H 'Authorization: Bearer sk-1234' \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "gpt-4o",
    "messages": [{"role": "user", "content": "Summarize the latest open PR"}],
    "tools": [{
      "type": "mcp",
      "server_url": "litellm_proxy/mcp/github",
      "server_label": "github_mcp",
      "require_approval": "never"
    }]
  }'

Use with Cursor IDE

{
  "mcpServers": {
    "LiteLLM": {
      "url": "http://localhost:4000/mcp/",
      "headers": {
        "x-litellm-api-key": "Bearer sk-1234"
      }
    }
  }
}

Docs: MCP Gateway

Supported Providers (Website Supported Models | Docs)

Provider /chat/completions /messages /responses /embeddings /image/generations /audio/transcriptions /audio/speech /moderations /batches /rerank
Abliteration (abliteration) โœ…
AI/ML API (aiml) โœ… โœ… โœ… โœ… โœ…
AI21 (ai21) โœ… โœ… โœ…
AI21 Chat (ai21_chat) โœ… โœ… โœ…
Aleph Alpha โœ… โœ… โœ…
Amazon Nova โœ… โœ… โœ…
Anthropic (anthropic) โœ… โœ… โœ… โœ…
Anthropic Text (anthropic_text) โœ… โœ… โœ… โœ…
Anyscale โœ… โœ… โœ…
AssemblyAI (assemblyai) โœ… โœ… โœ… โœ…
Auto Router (auto_router) โœ… โœ… โœ…
AWS - Bedrock (bedrock) โœ… โœ… โœ… โœ… โœ…
AWS - Sagemaker (sagemaker) โœ… โœ… โœ… โœ…
Azure (azure) โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Azure AI (azure_ai) โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Azure Text (azure_text) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Baseten (baseten) โœ… โœ… โœ…
Bytez (bytez) โœ… โœ… โœ…
Cerebras (cerebras) โœ… โœ… โœ…
Clarifai (clarifai) โœ… โœ… โœ…
Cloudflare AI Workers (cloudflare) โœ… โœ… โœ…
Codestral (codestral) โœ… โœ… โœ…
Cohere (cohere) โœ… โœ… โœ… โœ… โœ…
Cohere Chat (cohere_chat) โœ… โœ… โœ…
CometAPI (cometapi) โœ… โœ… โœ… โœ…
CompactifAI (compactifai) โœ… โœ… โœ…
Custom (custom) โœ… โœ… โœ…
Custom OpenAI (custom_openai) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Dashscope (dashscope) โœ… โœ… โœ… โœ… โœ…
Databricks (databricks) โœ… โœ… โœ…
DataRobot (datarobot) โœ… โœ… โœ…
Deepgram (deepgram) โœ… โœ… โœ… โœ…
DeepInfra (deepinfra) โœ… โœ… โœ…
Deepseek (deepseek) โœ… โœ… โœ…
ElevenLabs (elevenlabs) โœ… โœ… โœ… โœ… โœ…
Empower (empower) โœ… โœ… โœ…
Fal AI (fal_ai) โœ… โœ… โœ… โœ…
Featherless AI (featherless_ai) โœ… โœ… โœ…
Fireworks AI (fireworks_ai) โœ… โœ… โœ…
FriendliAI (friendliai) โœ… โœ… โœ…
Galadriel (galadriel) โœ… โœ… โœ…
GitHub Copilot (github_copilot) โœ… โœ… โœ… โœ…
GitHub Models (github) โœ… โœ… โœ…
Google - PaLM โœ… โœ… โœ…
Google - Vertex AI (vertex_ai) โœ… โœ… โœ… โœ… โœ…
Google AI Studio - Gemini (gemini) โœ… โœ… โœ…
GradientAI (gradient_ai) โœ… โœ… โœ…
Groq AI (groq) โœ… โœ… โœ…
Heroku (heroku) โœ… โœ… โœ…
Hosted VLLM (hosted_vllm) โœ… โœ… โœ…
Huggingface (huggingface) โœ… โœ… โœ… โœ… โœ…
Hyperbolic (hyperbolic) โœ… โœ… โœ…
IBM - Watsonx.ai (watsonx) โœ… โœ… โœ… โœ…
Infinity (infinity) โœ…
Jina AI (jina_ai) โœ…
Lambda AI (lambda_ai) โœ… โœ… โœ…
Lemonade (lemonade) โœ… โœ… โœ…
LiteLLM Proxy (litellm_proxy) โœ… โœ… โœ… โœ… โœ…
Llamafile (llamafile) โœ… โœ… โœ…
LM Studio (lm_studio) โœ… โœ… โœ…
Maritalk (maritalk) โœ… โœ… โœ…
Meta - Llama API (meta_llama) โœ… โœ… โœ…
Mistral AI API (mistral) โœ… โœ… โœ… โœ…
ModelScope (modelscope) โœ… โœ… โœ… โœ…
Moonshot (moonshot) โœ… โœ… โœ…
Morph (morph) โœ… โœ… โœ…
Nebius AI Studio (nebius) โœ… โœ… โœ… โœ…
NLP Cloud (nlp_cloud) โœ… โœ… โœ…
Novita AI (novita) โœ… โœ… โœ…
Nscale (nscale) โœ… โœ… โœ…
Nvidia NIM (nvidia_nim) โœ… โœ… โœ…
OCI (oci) โœ… โœ… โœ…
Ollama (ollama) โœ… โœ… โœ… โœ…
Ollama Chat (ollama_chat) โœ… โœ… โœ…
Oobabooga (oobabooga) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
OpenAI (openai) โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ…
OpenAI-like (openai_like) โœ…
OpenRouter (openrouter) โœ… โœ… โœ…
OVHCloud AI Endpoints (ovhcloud) โœ… โœ… โœ…
Perplexity AI (perplexity) โœ… โœ… โœ…
Petals (petals) โœ… โœ… โœ…
Pinstripes (pinstripes) โœ… โœ… โœ…
Predibase (predibase) โœ… โœ… โœ…
Recraft (recraft) โœ…
Replicate (replicate) โœ… โœ… โœ…
Sagemaker Chat (sagemaker_chat) โœ… โœ… โœ…
Sambanova (sambanova) โœ… โœ… โœ…
Snowflake (snowflake) โœ… โœ… โœ…
Text Completion Codestral (text-completion-codestral) โœ… โœ… โœ…
Text Completion OpenAI (text-completion-openai) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Together AI (together_ai) โœ… โœ… โœ…
Topaz (topaz) โœ… โœ… โœ…
Triton (triton) โœ… โœ… โœ…
V0 (v0) โœ… โœ… โœ…
Vercel AI Gateway (vercel_ai_gateway) โœ… โœ… โœ…
VLLM (vllm) โœ… โœ… โœ…
Volcengine (volcengine) โœ… โœ… โœ…
Voyage AI (voyage) โœ…
WandB Inference (wandb) โœ… โœ… โœ…
Watsonx Text (watsonx_text) โœ… โœ… โœ…
xAI (xai) โœ… โœ… โœ…
Xinference (xinference) โœ…

Read the Docs


Get Started

You can use LiteLLM through either the Proxy Server or Python SDK. Both give you a unified interface to access multiple LLMs (100+ LLMs). Choose the option that best fits your needs:

LiteLLM AI Gateway LiteLLM Python SDK
Use Case Central service (LLM Gateway) to access multiple LLMs Use LiteLLM directly in your Python code
Who Uses It? Gen AI Enablement / ML Platform Teams Developers building LLM projects
Key Features Centralized API gateway with authentication and authorization, multi-tenant cost tracking and spend management per project/user, per-project customization (logging, guardrails, caching), virtual keys for secure access control, admin dashboard UI for monitoring and management Direct Python library integration in your codebase, Router with retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router, application-level load balancing and cost tracking, exception handling with OpenAI-compatible errors, observability callbacks (Lunary, MLflow, Langfuse, etc.)

Stable Release: Use docker images with the -stable tag. These have undergone 12 hour load tests, before being published. More information about the release cycle here

Support for more providers. Missing a provider or LLM Platform, raise a feature request.

Deploy on AWS or GCP with Terraform

Run the LiteLLM proxy as a production-ready componentized stack (gateway, backend, UI on separate services; managed Postgres + Redis + object store) using the published Terraform modules. Both modules are on the public Terraform Registry โ€” no auth needed.

AWS โ€” ECS Fargate + Aurora + ElastiCache + ALB

Launch in AWS CloudShell โ€” opens an in-browser shell, already authenticated to your AWS account. Once inside, run:

git clone https://github.com/BerriAI/litellm.git
cd litellm/terraform/litellm/aws/examples/default
cp terraform.tfvars.example terraform.tfvars   # edit region/tenant/env
terraform init && terraform apply

Module page โ†’

Or call the module from your own root config:

# main.tf
terraform {
  required_version = ">= 1.6.0"
  required_providers {
    aws = { source = "hashicorp/aws", version = "~> 5.60" }
  }
}

provider "aws" {
  region = "us-west-2"
}

module "litellm" {
  source  = "BerriAI/litellm/aws"
  version = "~> 1.89"

  region = "us-west-2"
  azs    = ["us-west-2a", "us-west-2b"]
  tenant = "acme"
  env    = "prod"

  # Production: provide an ACM cert. Without one, set allow_plaintext_alb = true
  # (dev/trial only).
  # acm_certificate_arn = "arn:aws:acm:us-west-2:111122223333:certificate/..."
  allow_plaintext_alb = true
}

output "litellm_url" {
  value = module.litellm.alb_dns_name
}
terraform init
terraform apply

Provider API keys live in AWS Secrets Manager; reference ARNs via gateway_extra_secrets. Full input list and architecture diagram on the registry page.

GCP โ€” Cloud Run + Cloud SQL + Memorystore + HTTPS LB

Open in Cloud Shell

Real 1-click. Opens Cloud Shell, clones this repo, and walks you through terraform apply via a built-in DeployStack tutorial โ€” pick the project, the tutorial sets up the Artifact Registry remote repo, writes terraform.tfvars from your answers, and runs apply.

Module page โ†’

To call the module from your own config instead, Cloud Run can't pull from ghcr.io directly, so first set up a one-time Artifact Registry remote repo backed by GHCR:

gcloud artifacts repositories create litellm \
  --location=us-central1 \
  --repository-format=docker \
  --mode=remote-repository \
  --remote-docker-repo=https://ghcr.io \
  --project=my-gcp-project

Then:

# main.tf
terraform {
  required_version = ">= 1.6.0"
  required_providers {
    google      = { source = "hashicorp/google",      version = "~> 6.10" }
    google-beta = { source = "hashicorp/google-beta", version = "~> 6.10" }
  }
}

provider "google"      { project = "my-gcp-project"; region = "us-central1" }
provider "google-beta" { project = "my-gcp-project"; region = "us-central1" }

module "litellm" {
  source  = "BerriAI/litellm/google"
  version = "~> 1.89"

  project_id = "my-gcp-project"
  region     = "us-central1"
  tenant     = "acme"
  env        = "prod"

  # Replace my-gcp-project with your GCP project ID (same value as project_id above).
  image_registry = "us-central1-docker.pkg.dev/my-gcp-project/litellm/berriai"

  # Production: provide DNS already pointing at the LB IP for Google-managed certs.
  # Without one, set allow_plaintext_lb = true (dev/trial only).
  # lb_domains         = ["proxy.example.com"]
  allow_plaintext_lb = true
}

output "litellm_url" {
  value = module.litellm.load_balancer_url
}
terraform init
terraform apply

Provider API keys live in Secret Manager; reference resource IDs (e.g. projects/my-gcp-project/secrets/openai-api-key) via gateway_extra_secrets. Full input list and architecture diagram on the registry page.

Both stacks include

  • The full componentized split (gateway / backend / UI as independent services)
  • Managed Postgres (writer + reader) and Redis
  • Versioned object store for proxy state + file uploads
  • An auto-generated LITELLM_MASTER_KEY in your cloud's secret manager
  • A one-off migration job that runs prisma migrate deploy before the proxy starts
  • The same proxy_config surface as the Helm chart โ€” pass YAML as a typed map

The Terraform modules live at terraform/litellm/aws/ and terraform/litellm/gcp/ in this repo; the registry entries are read-only mirrors updated on each release.

Run in Developer Mode

Services

  1. Setup .env file in root
  2. Run dependent services docker-compose up db prometheus

Backend

  1. (In root) create virtual environment python -m venv .venv
  2. Activate virtual environment source .venv/bin/activate
  3. Install dependencies uv sync --all-extras --group proxy-dev
  4. uv run prisma generate
  5. prisma generate
  6. Start proxy backend python litellm/proxy/proxy_cli.py

Frontend

  1. Navigate to ui/litellm-dashboard
  2. Install dependencies npm install
  3. Run npm run dev to start the dashboard

Verify Docker Image Signatures

All LiteLLM Docker images published to GHCR are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:<release-tag>

Verify using a release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/<release-tag>/cosign.pub \
  ghcr.io/berriai/litellm:<release-tag>

Replace <release-tag> with the version you are deploying (e.g. v1.83.0-stable).


Enterprise

For companies that need better security, user management and professional support

Get an Enterprise License Talk to founders

This covers:

  • โœ… Features under the LiteLLM Commercial License:
  • โœ… Feature Prioritization
  • โœ… Custom Integrations
  • โœ… Professional Support - Dedicated discord + slack
  • โœ… Custom SLAs
  • โœ… Secure access with Single Sign-On

Contributing

We welcome contributions to LiteLLM! Whether you're fixing bugs, adding features, or improving documentation, we appreciate your help.

Quick Start for Contributors

This requires uv to be installed.

git clone https://github.com/BerriAI/litellm.git
cd litellm
make install-dev    # Install development dependencies
make format         # Format your code
make lint           # Run all linting checks
make test-unit      # Run unit tests
make format-check   # Check formatting only

For detailed contributing guidelines, see CONTRIBUTING.md.

๐Ÿ“– Contributing to documentation? The LiteLLM docs have moved to a separate repository: BerriAI/litellm-docs. Please open doc PRs there. Docs are served at docs.litellm.ai.

Code Quality / Linting

LiteLLM follows the Google Python Style Guide.

Our automated checks include:

  • Black for code formatting
  • Ruff for linting and code quality
  • MyPy for type checking
  • Circular import detection
  • Import safety checks

All these checks must pass before your PR can be merged.

Support / talk with founders

Contributors

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

litellm-1.92.2.tar.gz (15.1 MB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

litellm-1.92.2-cp313-cp313-win_amd64.whl (18.9 MB view details)

Uploaded CPython 3.13Windows x86-64

litellm-1.92.2-cp313-cp313-musllinux_1_2_x86_64.whl (19.4 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ x86-64

litellm-1.92.2-cp313-cp313-musllinux_1_2_aarch64.whl (19.4 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ ARM64

litellm-1.92.2-cp313-cp313-manylinux_2_28_x86_64.whl (19.3 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

litellm-1.92.2-cp313-cp313-manylinux_2_28_aarch64.whl (19.3 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

litellm-1.92.2-cp313-cp313-macosx_11_0_arm64.whl (19.0 MB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

litellm-1.92.2-cp313-cp313-macosx_10_12_x86_64.whl (19.1 MB view details)

Uploaded CPython 3.13macOS 10.12+ x86-64

litellm-1.92.2-cp312-cp312-win_amd64.whl (18.9 MB view details)

Uploaded CPython 3.12Windows x86-64

litellm-1.92.2-cp312-cp312-musllinux_1_2_x86_64.whl (19.4 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

litellm-1.92.2-cp312-cp312-musllinux_1_2_aarch64.whl (19.4 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ ARM64

litellm-1.92.2-cp312-cp312-manylinux_2_28_x86_64.whl (19.3 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

litellm-1.92.2-cp312-cp312-manylinux_2_28_aarch64.whl (19.3 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

litellm-1.92.2-cp312-cp312-macosx_11_0_arm64.whl (19.0 MB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

litellm-1.92.2-cp312-cp312-macosx_10_12_x86_64.whl (19.1 MB view details)

Uploaded CPython 3.12macOS 10.12+ x86-64

litellm-1.92.2-cp311-cp311-win_amd64.whl (18.9 MB view details)

Uploaded CPython 3.11Windows x86-64

litellm-1.92.2-cp311-cp311-musllinux_1_2_x86_64.whl (19.4 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

litellm-1.92.2-cp311-cp311-musllinux_1_2_aarch64.whl (19.4 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ ARM64

litellm-1.92.2-cp311-cp311-manylinux_2_28_x86_64.whl (19.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

litellm-1.92.2-cp311-cp311-manylinux_2_28_aarch64.whl (19.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

litellm-1.92.2-cp311-cp311-macosx_11_0_arm64.whl (19.0 MB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

litellm-1.92.2-cp311-cp311-macosx_10_12_x86_64.whl (19.1 MB view details)

Uploaded CPython 3.11macOS 10.12+ x86-64

litellm-1.92.2-cp310-cp310-win_amd64.whl (18.9 MB view details)

Uploaded CPython 3.10Windows x86-64

litellm-1.92.2-cp310-cp310-musllinux_1_2_x86_64.whl (19.4 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ x86-64

litellm-1.92.2-cp310-cp310-musllinux_1_2_aarch64.whl (19.4 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ ARM64

litellm-1.92.2-cp310-cp310-manylinux_2_28_x86_64.whl (19.3 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.28+ x86-64

litellm-1.92.2-cp310-cp310-manylinux_2_28_aarch64.whl (19.3 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.28+ ARM64

litellm-1.92.2-cp310-cp310-macosx_11_0_arm64.whl (19.0 MB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

litellm-1.92.2-cp310-cp310-macosx_10_12_x86_64.whl (19.1 MB view details)

Uploaded CPython 3.10macOS 10.12+ x86-64

File details

Details for the file litellm-1.92.2.tar.gz.

File metadata

  • Download URL: litellm-1.92.2.tar.gz
  • Upload date:
  • Size: 15.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm-1.92.2.tar.gz
Algorithm Hash digest
SHA256 e45043f6d8fd57bf62f75866cad7caf575251cb3183b983b6eb236245006c006
MD5 9563d97a1622c233c947f58c657ddaf2
BLAKE2b-256 8270c0d555c5c97b2d70b99b2c559142f3a76bd6d46b1d444e63bee2f5a72b45

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-win_amd64.whl.

File metadata

  • Download URL: litellm-1.92.2-cp313-cp313-win_amd64.whl
  • Upload date:
  • Size: 18.9 MB
  • Tags: CPython 3.13, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm-1.92.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 9834500a3af1781f1a2de94ebe9346a563e01a1ff0c63cbba1607245ca36a1aa
MD5 e884146b66d5d4037eaa4018f729f05d
BLAKE2b-256 e3d22a3c89e3400e87d518f8b10d35fa91d3abef461cb3de25d4c62e13c2b993

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp313-cp313-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 099970da48d25dd6ee49eecff4d1c02d97ed75d58bfdefe2bcc2a6eb6cf160af
MD5 bda598434d3db9c5b781498c2bcaf815
BLAKE2b-256 ecdfb285623b3d33a692a14f8377e22bcc296b68b1d3384b13c856fb5281cca5

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp313-cp313-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 15a6a69d4e72fac3fcbc0715eb0515198db67a3e3a8868cf39718f8d58adfafe
MD5 2c5116e0d9db664d1afd0901fbc20f2e
BLAKE2b-256 aace5a2b1bc071f457d7c910c0f6766dcc6ff89a532aeca48852287cb87a485f

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 59753ccfc3306810af285d589438d84ad31eb60bbc0956731922d2b8a09a74a0
MD5 4416f0835c285b53917472d05ef6f41a
BLAKE2b-256 11d5244b739e3c71f5418078415608ac58edad5a541ddb45f6e87ce9a7016a9e

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 2f6fa5bd10569fd20557a24b3bbb6c4e083f4f6cc473f59e746110f69ac09f07
MD5 03b9717b6e1a6927ac89146e0c7a77be
BLAKE2b-256 7ea4ae198585c91db2ae7b2a8ebb0c83e350b98a82cb3cf44c54e0d8687f3db5

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 95263e90dc7a30b3c37acd21afab1ff3c7e9ad4145a24fa0757227704d681e76
MD5 31c76d2ca4d4d1303211cd9942fedc6a
BLAKE2b-256 41f19173057dd2235ee0a21d41c35034de94a2ab1d61c00e6ac8f64f6e76f6be

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp313-cp313-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp313-cp313-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 cbc8c3ae3d82bc4949b811d30484fadc14f5d52eb8ec0e4a0f7b67ccd49b1786
MD5 5881ab265d21916ec7b631063056bc10
BLAKE2b-256 998a98e136341df8c13cb14b7f42fa41745abe1f09bdfbf0d52b051ac6998f5d

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-win_amd64.whl.

File metadata

  • Download URL: litellm-1.92.2-cp312-cp312-win_amd64.whl
  • Upload date:
  • Size: 18.9 MB
  • Tags: CPython 3.12, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm-1.92.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 587163add185c1eebc554676f6b348e2df9634b5f4f2f8ed0f171fbfc63373cc
MD5 e940e7bbad5858260115a65eec6966d3
BLAKE2b-256 642c59f317f93c79b464829f7751f6d66bdc5a09a99e4dea1807673f153f657d

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 aa276660b0c6513b55b3d062bcbfc914cebad99cd42e1d6e81d2b3a7133d69fc
MD5 c46f9474c3312bdb9f68bdc228ecd0f8
BLAKE2b-256 2f84677c936fa4f6c80e15c5bed5459fd4d1554786d588a88ff65cc80205b0c4

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp312-cp312-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 678bbba82cf9db574260fdaf82f43be644c7c5324d047fca7a583fdbfeeb3e5e
MD5 e521c640afef697b4299d45302a3a589
BLAKE2b-256 d432c9c3bc4bec58dbe6a62f8c24610750846c744130b8e7bd07f4bd91f37ad0

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 ab3e668b03b547025b94c41efd9c348bd6946d22aa0c1b472724c3b8b6549b06
MD5 78fd707577cfdc117ce61a8f32edbb0c
BLAKE2b-256 18d5a23a6fa1b3fbc1d31f8961a83356757fd08f7bea9bcdea4bb788ef560b5a

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 b2861df279c08f321fa5b24e8742395ac60518cc1618b55abf0aefe68a84fcf7
MD5 b68e35438e51e60e0d98d520048d4cbc
BLAKE2b-256 11f1cc73f79fa25fbf3c22ad9b790cd9cfdad1d5071325db06ca67214e020f36

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8f84297901029e4329d5b860ba8a192cf76bef8f7739389a4454d870a30e3baf
MD5 8615fb1457a7492317d3b19bd3df0b7b
BLAKE2b-256 5cfc18d979f2928991f3578eee6a8a3b517189f30a9445e44a7f0565b616b9e3

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp312-cp312-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp312-cp312-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 06db096a7af2fa50aff857d256103933a482e6bb654e9a8ad7ebae9f7a6aea23
MD5 9feb8636dbc1fd49aa956403a6605acf
BLAKE2b-256 e2d1c679ff62d2a71fa8d62d00e0bb64bec3a53991148c33797b1733fbc31282

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-win_amd64.whl.

File metadata

  • Download URL: litellm-1.92.2-cp311-cp311-win_amd64.whl
  • Upload date:
  • Size: 18.9 MB
  • Tags: CPython 3.11, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm-1.92.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 f672a8746da69f0d2a2ae5af445bd456a1a18750631817b9946fbe9a37b2cedc
MD5 ee257086da2bf900eae194e6db57ce25
BLAKE2b-256 0bd38c0f48462e91cc98e85aba2148f771e9f648182c30238a9d5ab41eb1c24e

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 ab31228df8d0c0dbda369b13cb6570c21effd986b2e6789e6341d9af176187ee
MD5 b02c5a610e9cd6a7c31f571e63d02d7a
BLAKE2b-256 849479c4cf1d991053fdfeb75cf4ceb51f305b005cb34b5fab79bf450eff51fa

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp311-cp311-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 b952215340ff1bd67b9d659dd33b1c566aec2904e11ef5149200819ae7ea62c6
MD5 e9b4355f1328f0320ca4dd386322478b
BLAKE2b-256 5cdbf8acfdd4ea96c161048eeffa325b6a9c1ae4b2b8e79714a6b92cce45326e

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 35851cf8cf5757da4767a4598fd9af5c13a7bbf13569d6f02b854705f1178d37
MD5 0dd2c3d62c5888c3416e584211fb19e6
BLAKE2b-256 61efd6f840ea8cea4c5fb00c37d88c26da4c638740cfaf3460aba0b4fc18b6db

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 be587bbe183407c8ddaf13b448a7652d360ba7d7da1e890c6a619b5f97174bff
MD5 0df1312afe8f458b0a7fae59e3b0b575
BLAKE2b-256 ab581003434d0f58a6d9f9637a58458dd1514413bbd5e22809bf108dd42ff6db

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 723d7e044247d56e742379083f57c0510c86153352fff2c0461b17f64ff2d87a
MD5 0b561c30032ad2d0221bfcd589b7dc1a
BLAKE2b-256 e14a4f8379af1adc65d1d9e878dcd264f81b846d1737a10829a83c0518d3e54c

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp311-cp311-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp311-cp311-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 5a75049e04c3b9e114c66889f031017e5bddd4f9e2644843424e1db7d31e4533
MD5 77f6153e0ca6b4dc788e9a71cd5932d9
BLAKE2b-256 51098deaa7b04a4bf3908d44e5db11cae57d32bfc93f2d1a058310b285ff02ee

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-win_amd64.whl.

File metadata

  • Download URL: litellm-1.92.2-cp310-cp310-win_amd64.whl
  • Upload date:
  • Size: 18.9 MB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm-1.92.2-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 42863eb56e7fc187fbc9d2adb6da9ad2a9c7af4dda7d05dcb99446c72fa99c0f
MD5 7942646fe83cee2e84d953deb8528d9e
BLAKE2b-256 f33d0ea54988d50e6f3805d3d29770eaf53ad337b6b52bae9d34ef7197a40d6a

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp310-cp310-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 d4853007a340ae966cacc860cd244581e46881f4424b9e15bb8e166cdd3ebdd1
MD5 2b0bd35db2f12814ddfab5e6c75e95dc
BLAKE2b-256 4c729028598b82b926b923f2363974578dd817b08d36760f6254bd6133131b5f

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp310-cp310-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 a4c028cb8eac7adaaceb9bbfd0a327ba4f07470ec3d4ddb2957ba2fc237d08c8
MD5 a43901d0d06aeae4c648e44bfaed9a59
BLAKE2b-256 ee4d24649460214e62bac6abe62cb6f1c3f1f9a65c40916e3c7b07c34c88fdec

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp310-cp310-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 4b9d286f92c85ca7dc593b777004392da073756ee766547a2074bbfa423c800d
MD5 cf7b588809f28fc71a249cb5e423512c
BLAKE2b-256 3718f34b6184945ad9a2b8316d64f609d34aa13f27c006877627273665e39c80

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp310-cp310-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 37d55f7eacb70984b54b3fbaf0a58ceda44dc825ee0358bdeb0be3d4d00efc32
MD5 4f212c776011c0419213c67094551b40
BLAKE2b-256 a800648527d22791182564adc5d8afca729e2466e1dafd7f105cbf8c4527be0a

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f943daa34e29605c2dada2d4794a06fc5bcf3ce94e83a046e358de0c0ee7a520
MD5 923dad1648e23287f9704faa970d29d0
BLAKE2b-256 6f4e21a11f7ce0ea9bcad4894d2fe8a3ab02f6705cf58fd157621010ba765dc3

See more details on using hashes here.

File details

Details for the file litellm-1.92.2-cp310-cp310-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.92.2-cp310-cp310-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 11c62f930b0b477bca0ab24633c798d4dd52ab6f4cf89a54dd3a24bf95fff97f
MD5 2e11aec3b112b396ea96890f68326df2
BLAKE2b-256 e35603810e9d91c8cd42529409f19d44c7b6a29e6d9a0411ef951db3e98af2d1

See more details on using hashes here.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page