Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

๐Ÿš… LiteLLM

LiteLLM AI Gateway

Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.

Deploy to Render Deploy on Railway Deploy on AWS Deploy on GCP

LiteLLM Proxy Server (AI Gateway) | Hosted Proxy | Enterprise Tier | Website

PyPI Version GitHub Stars Y Combinator W23 Whatsapp Discord Slack CodSpeed

LiteLLM AI Gateway

What is LiteLLM

LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers โ€” OpenAI, Anthropic, Gemini, Bedrock, Azure, and more โ€” using the OpenAI format.

Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.

Jump to LiteLLM Proxy (LLM Gateway) Docs
Jump to Supported LLM Providers


Why LiteLLM

Managing LLM calls across providers gets complicated fast โ€” different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:

  • Unified API โ€” one interface for 100+ LLMs, no provider-specific SDK juggling
  • Drop-in OpenAI compatibility โ€” swap providers without rewriting your code
  • Production-ready gateway โ€” virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box
  • 8ms P95 latency at 1k RPS (benchmarks)

OSS Adopters

Stripe image Google ADK Greptile OpenHands

Netflix

OpenAI Agents SDK

Features

LLMs - Call 100+ LLMs (Python SDK + AI Gateway)

All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.

Python SDK

uv add litellm
from litellm import completion
import os

os.environ["OPENAI_API_KEY"] = "your-openai-key"
os.environ["ANTHROPIC_API_KEY"] = "your-anthropic-key"

# OpenAI
response = completion(model="openai/gpt-4o", messages=[{"role": "user", "content": "Hello!"}])

# Anthropic  
response = completion(model="anthropic/claude-sonnet-4-20250514", messages=[{"role": "user", "content": "Hello!"}])

AI Gateway (Proxy Server)

Getting Started - E2E Tutorial - Setup virtual keys, make your first request

uv tool install 'litellm[proxy]'
litellm --model gpt-4o
import openai

client = openai.OpenAI(api_key="anything", base_url="http://0.0.0.0:4000")
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}]
)

Docs: LLM Providers

Agents - Invoke A2A Agents (Python SDK + AI Gateway)

Supported Providers - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI

Python SDK - A2A Protocol

from litellm.a2a_protocol import A2AClient
from a2a.types import SendMessageRequest, MessageSendParams
from uuid import uuid4

client = A2AClient(base_url="http://localhost:10001")

request = SendMessageRequest(
    id=str(uuid4()),
    params=MessageSendParams(
        message={
            "role": "user",
            "parts": [{"kind": "text", "text": "Hello!"}],
            "messageId": uuid4().hex,
        }
    )
)
response = await client.send_message(request)

AI Gateway (Proxy Server)

Step 1. Add your Agent to the AI Gateway โ€” set protocolVersion to 1.0 or 0.3 per agent

Step 2. Call Agent via A2A SDK (requires a2a-sdk>=1.1.0)

import httpx
from a2a.client import A2ACardResolver, ClientConfig, ClientFactory
from a2a.types import Message, Part, Role, SendMessageRequest
from a2a.utils.constants import TransportProtocol
from uuid import uuid4

base_url = "http://localhost:4000/a2a/my-agent"  # LiteLLM proxy + agent name
headers = {"Authorization": "Bearer sk-1234"}    # LiteLLM Virtual Key

async with httpx.AsyncClient(headers=headers, timeout=60.0) as http_client:
    resolver = A2ACardResolver(httpx_client=http_client, base_url=base_url)
    agent_card = await resolver.get_agent_card()
    config = ClientConfig(
        httpx_client=http_client,
        streaming=False,
        supported_protocol_bindings=[TransportProtocol.JSONRPC, TransportProtocol.HTTP_JSON],
    )
    client = ClientFactory(config).create(agent_card)

    request = SendMessageRequest(
        message=Message(
            message_id=uuid4().hex,
            role=Role.ROLE_USER,
            parts=[Part(text="Hello!")],
        )
    )
    async for event in client.send_message(request):
        populated = event.ListFields()
        if populated and populated[0][0].name in ("message", "msg"):
            print("".join(getattr(p, "text", "") or "" for p in populated[0][1].parts))

Docs: A2A Agent Gateway

MCP Tools - Connect MCP servers to any LLM (Python SDK + AI Gateway)

Python SDK - MCP Bridge

from mcp import ClientSession, StdioServerParameters
from mcp.client.stdio import stdio_client
from litellm import experimental_mcp_client
import litellm

server_params = StdioServerParameters(command="python", args=["mcp_server.py"])

async with stdio_client(server_params) as (read, write):
    async with ClientSession(read, write) as session:
        await session.initialize()

        # Load MCP tools in OpenAI format
        tools = await experimental_mcp_client.load_mcp_tools(session=session, format="openai")

        # Use with any LiteLLM model
        response = await litellm.acompletion(
            model="gpt-4o",
            messages=[{"role": "user", "content": "What's 3 + 5?"}],
            tools=tools
        )

AI Gateway - MCP Gateway

Step 1. Add your MCP Server to the AI Gateway

Step 2. Call MCP tools via /chat/completions

curl -X POST 'http://0.0.0.0:4000/v1/chat/completions' \
  -H 'Authorization: Bearer sk-1234' \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "gpt-4o",
    "messages": [{"role": "user", "content": "Summarize the latest open PR"}],
    "tools": [{
      "type": "mcp",
      "server_url": "litellm_proxy/mcp/github",
      "server_label": "github_mcp",
      "require_approval": "never"
    }]
  }'

Use with Cursor IDE

{
  "mcpServers": {
    "LiteLLM": {
      "url": "http://localhost:4000/mcp/",
      "headers": {
        "x-litellm-api-key": "Bearer sk-1234"
      }
    }
  }
}

Docs: MCP Gateway

Supported Providers (Website Supported Models | Docs)

Provider /chat/completions /messages /responses /embeddings /image/generations /audio/transcriptions /audio/speech /moderations /batches /rerank
Abliteration (abliteration) โœ…
AI/ML API (aiml) โœ… โœ… โœ… โœ… โœ…
AI21 (ai21) โœ… โœ… โœ…
AI21 Chat (ai21_chat) โœ… โœ… โœ…
Aleph Alpha โœ… โœ… โœ…
Amazon Nova โœ… โœ… โœ…
Anthropic (anthropic) โœ… โœ… โœ… โœ…
Anthropic Text (anthropic_text) โœ… โœ… โœ… โœ…
Anyscale โœ… โœ… โœ…
AssemblyAI (assemblyai) โœ… โœ… โœ… โœ…
Auto Router (auto_router) โœ… โœ… โœ…
AWS - Bedrock (bedrock) โœ… โœ… โœ… โœ… โœ…
AWS - Sagemaker (sagemaker) โœ… โœ… โœ… โœ…
Azure (azure) โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Azure AI (azure_ai) โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Azure Text (azure_text) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Baseten (baseten) โœ… โœ… โœ…
Bytez (bytez) โœ… โœ… โœ…
Cerebras (cerebras) โœ… โœ… โœ…
Clarifai (clarifai) โœ… โœ… โœ…
Cloudflare AI Workers (cloudflare) โœ… โœ… โœ…
Codestral (codestral) โœ… โœ… โœ…
Cohere (cohere) โœ… โœ… โœ… โœ… โœ…
Cohere Chat (cohere_chat) โœ… โœ… โœ…
CometAPI (cometapi) โœ… โœ… โœ… โœ…
CompactifAI (compactifai) โœ… โœ… โœ…
Custom (custom) โœ… โœ… โœ…
Custom OpenAI (custom_openai) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Dashscope (dashscope) โœ… โœ… โœ… โœ… โœ…
Databricks (databricks) โœ… โœ… โœ…
DataRobot (datarobot) โœ… โœ… โœ…
Deepgram (deepgram) โœ… โœ… โœ… โœ…
DeepInfra (deepinfra) โœ… โœ… โœ…
Deepseek (deepseek) โœ… โœ… โœ…
ElevenLabs (elevenlabs) โœ… โœ… โœ… โœ… โœ…
Empower (empower) โœ… โœ… โœ…
Fal AI (fal_ai) โœ… โœ… โœ… โœ…
Featherless AI (featherless_ai) โœ… โœ… โœ…
Fireworks AI (fireworks_ai) โœ… โœ… โœ…
FriendliAI (friendliai) โœ… โœ… โœ…
Galadriel (galadriel) โœ… โœ… โœ…
GitHub Copilot (github_copilot) โœ… โœ… โœ… โœ…
GitHub Models (github) โœ… โœ… โœ…
Google - PaLM โœ… โœ… โœ…
Google - Vertex AI (vertex_ai) โœ… โœ… โœ… โœ… โœ…
Google AI Studio - Gemini (gemini) โœ… โœ… โœ…
GradientAI (gradient_ai) โœ… โœ… โœ…
Groq AI (groq) โœ… โœ… โœ…
Heroku (heroku) โœ… โœ… โœ…
Hosted VLLM (hosted_vllm) โœ… โœ… โœ…
Huggingface (huggingface) โœ… โœ… โœ… โœ… โœ…
Hyperbolic (hyperbolic) โœ… โœ… โœ…
IBM - Watsonx.ai (watsonx) โœ… โœ… โœ… โœ…
Infinity (infinity) โœ…
Jina AI (jina_ai) โœ…
Lambda AI (lambda_ai) โœ… โœ… โœ…
Lemonade (lemonade) โœ… โœ… โœ…
LiteLLM Proxy (litellm_proxy) โœ… โœ… โœ… โœ… โœ…
Llamafile (llamafile) โœ… โœ… โœ…
LM Studio (lm_studio) โœ… โœ… โœ…
Maritalk (maritalk) โœ… โœ… โœ…
Meta - Llama API (meta_llama) โœ… โœ… โœ…
Mistral AI API (mistral) โœ… โœ… โœ… โœ…
ModelScope (modelscope) โœ… โœ… โœ… โœ…
Moonshot (moonshot) โœ… โœ… โœ…
Morph (morph) โœ… โœ… โœ…
Nebius AI Studio (nebius) โœ… โœ… โœ… โœ…
NLP Cloud (nlp_cloud) โœ… โœ… โœ…
Novita AI (novita) โœ… โœ… โœ…
Nscale (nscale) โœ… โœ… โœ…
Nvidia NIM (nvidia_nim) โœ… โœ… โœ…
OCI (oci) โœ… โœ… โœ…
Ollama (ollama) โœ… โœ… โœ… โœ…
Ollama Chat (ollama_chat) โœ… โœ… โœ…
Oobabooga (oobabooga) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
OpenAI (openai) โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ… โœ…
OpenAI-like (openai_like) โœ…
OpenRouter (openrouter) โœ… โœ… โœ…
OVHCloud AI Endpoints (ovhcloud) โœ… โœ… โœ…
Perplexity AI (perplexity) โœ… โœ… โœ…
Petals (petals) โœ… โœ… โœ…
Pinstripes (pinstripes) โœ… โœ… โœ…
Predibase (predibase) โœ… โœ… โœ…
Recraft (recraft) โœ…
Replicate (replicate) โœ… โœ… โœ…
Sagemaker Chat (sagemaker_chat) โœ… โœ… โœ…
Sambanova (sambanova) โœ… โœ… โœ…
Snowflake (snowflake) โœ… โœ… โœ…
Text Completion Codestral (text-completion-codestral) โœ… โœ… โœ…
Text Completion OpenAI (text-completion-openai) โœ… โœ… โœ… โœ… โœ… โœ… โœ…
Together AI (together_ai) โœ… โœ… โœ…
Topaz (topaz) โœ… โœ… โœ…
Triton (triton) โœ… โœ… โœ…
V0 (v0) โœ… โœ… โœ…
Vercel AI Gateway (vercel_ai_gateway) โœ… โœ… โœ…
VLLM (vllm) โœ… โœ… โœ…
Volcengine (volcengine) โœ… โœ… โœ…
Voyage AI (voyage) โœ…
WandB Inference (wandb) โœ… โœ… โœ…
Watsonx Text (watsonx_text) โœ… โœ… โœ…
xAI (xai) โœ… โœ… โœ…
Xinference (xinference) โœ…

Read the Docs


Get Started

You can use LiteLLM through either the Proxy Server or Python SDK. Both give you a unified interface to access multiple LLMs (100+ LLMs). Choose the option that best fits your needs:

LiteLLM AI Gateway LiteLLM Python SDK
Use Case Central service (LLM Gateway) to access multiple LLMs Use LiteLLM directly in your Python code
Who Uses It? Gen AI Enablement / ML Platform Teams Developers building LLM projects
Key Features Centralized API gateway with authentication and authorization, multi-tenant cost tracking and spend management per project/user, per-project customization (logging, guardrails, caching), virtual keys for secure access control, admin dashboard UI for monitoring and management Direct Python library integration in your codebase, Router with retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router, application-level load balancing and cost tracking, exception handling with OpenAI-compatible errors, observability callbacks (Lunary, MLflow, Langfuse, etc.)

Stable Release: Use docker images with the -stable tag. These have undergone 12 hour load tests, before being published. More information about the release cycle here

Support for more providers. Missing a provider or LLM Platform, raise a feature request.

Deploy on AWS or GCP with Terraform

Run the LiteLLM proxy as a production-ready componentized stack (gateway, backend, UI on separate services; managed Postgres + Redis + object store) using the published Terraform modules. Both modules are on the public Terraform Registry โ€” no auth needed.

AWS โ€” ECS Fargate + Aurora + ElastiCache + ALB

Launch in AWS CloudShell โ€” opens an in-browser shell, already authenticated to your AWS account. Once inside, run:

git clone https://github.com/BerriAI/litellm.git
cd litellm/terraform/litellm/aws/examples/default
cp terraform.tfvars.example terraform.tfvars   # edit region/tenant/env
terraform init && terraform apply

Module page โ†’

Or call the module from your own root config:

# main.tf
terraform {
  required_version = ">= 1.6.0"
  required_providers {
    aws = { source = "hashicorp/aws", version = "~> 5.60" }
  }
}

provider "aws" {
  region = "us-west-2"
}

module "litellm" {
  source  = "BerriAI/litellm/aws"
  version = "~> 1.89"

  region = "us-west-2"
  azs    = ["us-west-2a", "us-west-2b"]
  tenant = "acme"
  env    = "prod"

  # Production: provide an ACM cert. Without one, set allow_plaintext_alb = true
  # (dev/trial only).
  # acm_certificate_arn = "arn:aws:acm:us-west-2:111122223333:certificate/..."
  allow_plaintext_alb = true
}

output "litellm_url" {
  value = module.litellm.alb_dns_name
}
terraform init
terraform apply

Provider API keys live in AWS Secrets Manager; reference ARNs via gateway_extra_secrets. Full input list and architecture diagram on the registry page.

GCP โ€” Cloud Run + Cloud SQL + Memorystore + HTTPS LB

Open in Cloud Shell

Real 1-click. Opens Cloud Shell, clones this repo, and walks you through terraform apply via a built-in DeployStack tutorial โ€” pick the project, the tutorial sets up the Artifact Registry remote repo, writes terraform.tfvars from your answers, and runs apply.

Module page โ†’

To call the module from your own config instead, Cloud Run can't pull from ghcr.io directly, so first set up a one-time Artifact Registry remote repo backed by GHCR:

gcloud artifacts repositories create litellm \
  --location=us-central1 \
  --repository-format=docker \
  --mode=remote-repository \
  --remote-docker-repo=https://ghcr.io \
  --project=my-gcp-project

Then:

# main.tf
terraform {
  required_version = ">= 1.6.0"
  required_providers {
    google      = { source = "hashicorp/google",      version = "~> 6.10" }
    google-beta = { source = "hashicorp/google-beta", version = "~> 6.10" }
  }
}

provider "google"      { project = "my-gcp-project"; region = "us-central1" }
provider "google-beta" { project = "my-gcp-project"; region = "us-central1" }

module "litellm" {
  source  = "BerriAI/litellm/google"
  version = "~> 1.89"

  project_id = "my-gcp-project"
  region     = "us-central1"
  tenant     = "acme"
  env        = "prod"

  # Replace my-gcp-project with your GCP project ID (same value as project_id above).
  image_registry = "us-central1-docker.pkg.dev/my-gcp-project/litellm/berriai"

  # Production: provide DNS already pointing at the LB IP for Google-managed certs.
  # Without one, set allow_plaintext_lb = true (dev/trial only).
  # lb_domains         = ["proxy.example.com"]
  allow_plaintext_lb = true
}

output "litellm_url" {
  value = module.litellm.load_balancer_url
}
terraform init
terraform apply

Provider API keys live in Secret Manager; reference resource IDs (e.g. projects/my-gcp-project/secrets/openai-api-key) via gateway_extra_secrets. Full input list and architecture diagram on the registry page.

Both stacks include

  • The full componentized split (gateway / backend / UI as independent services)
  • Managed Postgres (writer + reader) and Redis
  • Versioned object store for proxy state + file uploads
  • An auto-generated LITELLM_MASTER_KEY in your cloud's secret manager
  • A one-off migration job that runs prisma migrate deploy before the proxy starts
  • The same proxy_config surface as the Helm chart โ€” pass YAML as a typed map

The Terraform modules live at terraform/litellm/aws/ and terraform/litellm/gcp/ in this repo; the registry entries are read-only mirrors updated on each release.

Run in Developer Mode

Services

  1. Setup .env file in root
  2. Run dependent services docker-compose up db prometheus

Backend

  1. Run make bootstrap
  2. Start proxy backend: uv run python litellm/proxy/proxy_cli.py

Frontend

  1. Navigate to ui/litellm-dashboard (dependencies were already installed w/ make bootstrap)
  2. Start dashboard: npm run dev

Verify Docker Image Signatures

All LiteLLM Docker images published to GHCR are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:<release-tag>

Verify using a release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/<release-tag>/cosign.pub \
  ghcr.io/berriai/litellm:<release-tag>

Replace <release-tag> with the version you are deploying (e.g. v1.83.0-stable).


Enterprise

For companies that need better security, user management and professional support

Get an Enterprise License Talk to founders

This covers:

  • โœ… Features under the LiteLLM Commercial License:
  • โœ… Feature Prioritization
  • โœ… Custom Integrations
  • โœ… Professional Support - Dedicated discord + slack
  • โœ… Custom SLAs
  • โœ… Secure access with Single Sign-On

Contributing

We welcome contributions to LiteLLM! Whether you're fixing bugs, adding features, or improving documentation, we appreciate your help.

Quick Start for Contributors

This requires uv to be installed.

git clone https://github.com/BerriAI/litellm.git
cd litellm
make install-dev    # Install development dependencies
make format         # Format your code
make lint           # Run all linting checks
make test-unit      # Run unit tests
make format-check   # Check formatting only

For detailed contributing guidelines, see CONTRIBUTING.md.

๐Ÿ“– Contributing to documentation? The LiteLLM docs have moved to a separate repository: BerriAI/litellm-docs. Please open doc PRs there. Docs are served at docs.litellm.ai.

Code Quality / Linting

LiteLLM follows the Google Python Style Guide.

Our automated checks include:

  • Black for code formatting
  • Ruff for linting and code quality
  • MyPy for type checking
  • Circular import detection
  • Import safety checks

All these checks must pass before your PR can be merged.

Support / talk with founders

Contributors

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

litellm-1.97.0rc1.tar.gz (17.8 MB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

litellm-1.97.0rc1-cp314-cp314-win_amd64.whl (25.2 MB view details)

Uploaded CPython 3.14Windows x86-64

litellm-1.97.0rc1-cp314-cp314-musllinux_1_2_x86_64.whl (27.0 MB view details)

Uploaded CPython 3.14musllinux: musl 1.2+ x86-64

litellm-1.97.0rc1-cp314-cp314-musllinux_1_2_aarch64.whl (26.8 MB view details)

Uploaded CPython 3.14musllinux: musl 1.2+ ARM64

litellm-1.97.0rc1-cp314-cp314-manylinux_2_28_x86_64.whl (26.6 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

litellm-1.97.0rc1-cp314-cp314-manylinux_2_28_aarch64.whl (26.7 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

litellm-1.97.0rc1-cp314-cp314-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.14macOS 11.0+ ARM64

litellm-1.97.0rc1-cp314-cp314-macosx_10_12_x86_64.whl (26.1 MB view details)

Uploaded CPython 3.14macOS 10.12+ x86-64

litellm-1.97.0rc1-cp313-cp313-win_amd64.whl (25.2 MB view details)

Uploaded CPython 3.13Windows x86-64

litellm-1.97.0rc1-cp313-cp313-musllinux_1_2_x86_64.whl (27.0 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ x86-64

litellm-1.97.0rc1-cp313-cp313-musllinux_1_2_aarch64.whl (26.8 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ ARM64

litellm-1.97.0rc1-cp313-cp313-manylinux_2_28_x86_64.whl (26.6 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

litellm-1.97.0rc1-cp313-cp313-manylinux_2_28_aarch64.whl (26.7 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

litellm-1.97.0rc1-cp313-cp313-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

litellm-1.97.0rc1-cp313-cp313-macosx_10_12_x86_64.whl (26.1 MB view details)

Uploaded CPython 3.13macOS 10.12+ x86-64

litellm-1.97.0rc1-cp312-cp312-win_amd64.whl (25.2 MB view details)

Uploaded CPython 3.12Windows x86-64

litellm-1.97.0rc1-cp312-cp312-musllinux_1_2_x86_64.whl (27.0 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

litellm-1.97.0rc1-cp312-cp312-musllinux_1_2_aarch64.whl (26.8 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ ARM64

litellm-1.97.0rc1-cp312-cp312-manylinux_2_28_x86_64.whl (26.6 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

litellm-1.97.0rc1-cp312-cp312-manylinux_2_28_aarch64.whl (26.7 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

litellm-1.97.0rc1-cp312-cp312-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

litellm-1.97.0rc1-cp312-cp312-macosx_10_12_x86_64.whl (26.1 MB view details)

Uploaded CPython 3.12macOS 10.12+ x86-64

litellm-1.97.0rc1-cp311-cp311-win_amd64.whl (25.2 MB view details)

Uploaded CPython 3.11Windows x86-64

litellm-1.97.0rc1-cp311-cp311-musllinux_1_2_x86_64.whl (27.0 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

litellm-1.97.0rc1-cp311-cp311-musllinux_1_2_aarch64.whl (26.8 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ ARM64

litellm-1.97.0rc1-cp311-cp311-manylinux_2_28_x86_64.whl (26.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

litellm-1.97.0rc1-cp311-cp311-manylinux_2_28_aarch64.whl (26.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

litellm-1.97.0rc1-cp311-cp311-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

litellm-1.97.0rc1-cp311-cp311-macosx_10_12_x86_64.whl (26.1 MB view details)

Uploaded CPython 3.11macOS 10.12+ x86-64

litellm-1.97.0rc1-cp310-cp310-win_amd64.whl (25.2 MB view details)

Uploaded CPython 3.10Windows x86-64

litellm-1.97.0rc1-cp310-cp310-musllinux_1_2_x86_64.whl (27.0 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ x86-64

litellm-1.97.0rc1-cp310-cp310-musllinux_1_2_aarch64.whl (26.8 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ ARM64

litellm-1.97.0rc1-cp310-cp310-manylinux_2_28_x86_64.whl (26.6 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.28+ x86-64

litellm-1.97.0rc1-cp310-cp310-manylinux_2_28_aarch64.whl (26.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.28+ ARM64

litellm-1.97.0rc1-cp310-cp310-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

litellm-1.97.0rc1-cp310-cp310-macosx_10_12_x86_64.whl (26.1 MB view details)

Uploaded CPython 3.10macOS 10.12+ x86-64

File details

Details for the file litellm-1.97.0rc1.tar.gz.

File metadata

  • Download URL: litellm-1.97.0rc1.tar.gz
  • Upload date:
  • Size: 17.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for litellm-1.97.0rc1.tar.gz
Algorithm Hash digest
SHA256 f3457e09224021dc53dd6d516860678c77206d80a9d7626d855eb88c7a39b4c5
MD5 4c69cac913aae917401cbde377f24865
BLAKE2b-256 2221268b0137d7b16760b2f434e5fd07cdda845d7f3ab58a725978c88d49c994

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 70adfe865478cd7576bb67bd657c20ae52fae1b157eb03e222abe7268d745868
MD5 b2cc9952ccfa584048d10d446d83f43b
BLAKE2b-256 e5d07fa00bc1914d5f28f415ccd8e7df76c7e59e8a46a194233cdfcc1d4042e3

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 1a40debf60117e46f5a8ad5af997a68861beb55a6bad316f5604cb567aa73289
MD5 ff94653f569d76ee1e6508efa506d500
BLAKE2b-256 174259f8461e1954a1e64fa331a7e1bfeec45d31954153ceee29f0cfdddd3932

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 0ae4684712f9a20d41161585ca126a851c712f5e7f8caa3d1dde6c64cd422d0d
MD5 1378c287a3908292124fc2ac71895a66
BLAKE2b-256 15a7a3b032e82faf83b8043ce0d546f6d3dec8a6d9e2a58a65cd3d3996871153

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 963562f095965c2f5714418e327c1779826bb4e37de8b53fb408e68eaf4e6db7
MD5 45fff9ba013f7283a7b440de010c44a2
BLAKE2b-256 0131b9a406fb3e2e254bbdcfd2ca90f4c820542c002a11a42b5b095da264b7c1

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 fd90efb3e3cd8fbead2f73d5eba63e61a0d3270c2ec35fc7defb479a23c94a00
MD5 f81b1351daf608d3f84841d33cd2459a
BLAKE2b-256 2a99545dbaf29f56ad2f9864934631a56531375805c4a5611d4d8ef2d32371a5

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c85070fb694bbe6f18cf6775edb36c134e32168f237d2d75aee47854d46613ac
MD5 bd19ad10a56c3acbc6d04c879385ba13
BLAKE2b-256 3ac721665fab8a7158ecfbcdf39e7f86ebfc4061cca11bd7871f3a2ca829768b

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp314-cp314-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp314-cp314-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 3a9c7b361d2d8a15062db21e74f540934d4156488b7f28c179ea8d6382be45f9
MD5 df64026f883415bda85632509dab034f
BLAKE2b-256 96e51ff6854f640870125478cade57bcee4d20c48604cdda8b520084fd029707

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 13dcfbbc313927182be9671799897e8f4b77f84ff188bb245e583f4cf909100a
MD5 795c1bf49d1d8b37e62c272293b8affd
BLAKE2b-256 86aa61a36845521350a7070af17757719123f684b118b362996da590b3c593bb

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 6ea3c281b52c8160d7cef0419135c0852abcc87e771c8dafdbd538855c57f880
MD5 5f7ac11679263b47c3de081a902d65ff
BLAKE2b-256 227afd74cf40938fc8a9fafa24bbc66016fdac200b88b43a23ecbc8948614319

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 0594cb7328fdb5a2827fb01ae1a6deb4d93330c1bf1258acc3c5b7a28e8b51ee
MD5 4086c30afa37eebd789989765a853e97
BLAKE2b-256 fd68c860e05f9b488eddabf1767bbf7142290c081602abbfcfa90fa78024adc1

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 0631e98ecb728975add7698d92fe22bd20b52eac03255e17544944f8a2683f6a
MD5 cae4178585c7b1733ebc6b5c879f5b66
BLAKE2b-256 681541d4bad7c3f77de7ac6c7f85bee1b39b4eaf6fd8034fbce4701061d384c5

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 b914391d6741a353e992e2218d94cd8c358e103e131b90741599d98dd59f013a
MD5 46964979e615824ea0f649f1b6290927
BLAKE2b-256 f309b78b654b87466ad60074427bdb4cd1bac9e4853cc6fbd517aafc86fe03d8

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8ff04447c4bce8efe28e634b52c9596e3d1afe7f0773a754729a41275dd2ac4b
MD5 7d73117f76136d1bb3607d4a78c4152e
BLAKE2b-256 8066b8ce05a77b2e6dca185881f8c65155e45f5d94ca21628130044374c000d1

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp313-cp313-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp313-cp313-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 ddbbd9dc1f387c85d5ada5e317b7d2d6ff496a7dca9f6cd0ee8895cf315b23be
MD5 cb41b2a50fc58438a466c9f2cdc3d135
BLAKE2b-256 213b9a43cc9d71cfb74201910648cc932a06809a9ff7a623e7b97cbd21a7c654

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 f19479f7c12d00abc6431a01fc621193776425f7446867d208bb7d5246a28fb8
MD5 73cfc1e4c6ab023473c969aa3dbdd340
BLAKE2b-256 95fcf2d29483dc639c28d1050f3a64b60f5754b03a89466f14f5ebaa67922835

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 aa91633e0f8fba6d2a1329fe6c121364274923c1aa7900aba92a696889538bd7
MD5 fecf796eb3717b510f3da7e326664c01
BLAKE2b-256 087524f5111afa45a1c0591c6ab79662967cc606c4b2327f46a02ce2321ca5b7

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 4b93254e65733eef4c61b35e03edc1ced94ee2ba903d4aa1290de9b3f67b5799
MD5 92f23c548feb0c87197f9eb99488816b
BLAKE2b-256 f5f41905cb44708d5b074cdd63c627b0430fb39c47350eaaaf85e57cd3b9262a

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 ef2ef06b849a5bef2e4e22bb86744c0a765208b59792ff85cd97d57607e2736b
MD5 8cce5d2ee600e9fef67c6d20c209d44e
BLAKE2b-256 cd69ff63da312e53f4191e0d722802385bd6bc41fd42205c9f090144a397960e

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 392639b25354b6ee40b9d3960615e8f2a666230f7b709b3009aa2d46c8cb9a03
MD5 2c70b113b10e2390f110451cfddfd01f
BLAKE2b-256 3f21b1b16bfd8368d72994da7d9b283e464d76d8e875133b6f2222378f056043

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 bc489e538332c0169b9efedca3386c385043228442e39d55ce8bdc92c7468241
MD5 b499d133c03f9ac9a433c99225473963
BLAKE2b-256 ee0028c371e2e1927e5679db63f6dce96b7e830cee48d6b23a581ab31dd7b25d

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp312-cp312-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp312-cp312-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 bb5ac723f357dc043d146e82a3273443c82996cf426e0c89a965220207c56314
MD5 313674d73f5575c99fd4ad72e9db935a
BLAKE2b-256 dd9a946c8f7be4c7493c8c28a3b5c22a513b9d72de242aa090213a14ded00f7b

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 6d01a49d965f93fda666599c252117ba13ac55a739b997bec90bf3601d4503e3
MD5 7e3348b11b6d4b6f759389d34ece65d7
BLAKE2b-256 3f5b5b35670fd055a0e9002522f0bfe55ee9b96b29956af393786bbac277fa25

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 587533f49694c064cb49515557b83fb8d38cbead99bb5632768b08ba9240349a
MD5 a30b4f733fa180a67b3379e1a387683f
BLAKE2b-256 68e7290b281cff429409e96e9a4d781ec8e316095492ba4dbf69f9a78fb38c54

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 dc24f67ea3db50900f9302ebce946e2da5691dc74c5319bae5aa391d9b506abd
MD5 4358a2ece71b77600d77b183b20b26ec
BLAKE2b-256 6d9fbb89cfd181148f09d92430b45f2c012ddd0db4e70aa34aa309e5d7f8d513

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 7fca504dcf503b9d8e8961b2cd85d7fa7daa2831a2aba6184ec9fa276b6b53e8
MD5 fb612705411b744680a37f7ab0447e71
BLAKE2b-256 36f375b486c685c236a0889de4ee66adef83a5a6926ae88da133a6b9867da0da

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 f4694e4d6228aa21df52272c1c611c390348a051727d4b9acab747e68bdff34a
MD5 ee63d5c3471740ff54c594b4f56370e6
BLAKE2b-256 445a140225adf81ec6d8e360fba44fb4b9d744e29cb14009417d777032cd927c

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 a433cb729db01305ebca21e94c4d5ad11f896edf0e1c99b8699510db34eaf72d
MD5 57e3c59ba8ead9fa4c76d194f23d58bb
BLAKE2b-256 028c4ef2e4c6f91fdc30b335038d22c339789539304591ba0741c6ec01500889

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp311-cp311-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp311-cp311-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 96171b49371a334ef0e6471ec14c3cd2dcaa3211c2c4bb644d9c44dd00bbbd0d
MD5 90186b56c0221cf1860deaa02e3a67ab
BLAKE2b-256 be33418ca9814f66913a2ec5e9c5ba283682ae8341804dd9ba09b163678fb383

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-win_amd64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 b26d9d9f93ecd543e9b8548acac24d32d200593a844b85327e82640358d036d3
MD5 194fdae0d26845b201e6f74dfe384cca
BLAKE2b-256 99a5eb2d529606c8495dc97f63a0acd3791099455d337ed3c343626a38bcda20

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 5d8077c7954cd81c9f18650951b21e2b64a2c4ca6313396f22f6b5f9edcc3dbb
MD5 6410b837af92e34ac8a1c0b4d5c098ea
BLAKE2b-256 497dfe09c0eb7cb6f9489717501958191773565ef7780d35e616e1f82d5e0f87

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 7a3fc5b1cb9b52ef5d08f02ec66aed01e2bdeb691c471e343ea7be12a683a551
MD5 dd8c301d43ac478c78e1d1dd1d42a514
BLAKE2b-256 e5e3b4b21d0dcd2268ade126b33c630d3c4ea425f7095063cbcdc11fde10947a

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 9b87f11962a784507c0cf0181d82a3a41fb092deb11c3864d90ee35a8b603cc6
MD5 20bef29eef4fc4a2e6be8fbb24480d59
BLAKE2b-256 8c4364f5022e4a7dcc5232ae1ab10ae953c62b994f52122d3fa506bb6cd847e4

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 a6f3d4845fa4ef8f0396ae2bb10328980294736d86682f5c3926de9f391aa2e3
MD5 92d7d20d1409ed4b1042cea2bbe75c8e
BLAKE2b-256 a3670c4051ff0658133a000f9d28349de7ac38c4ef04f7613e09214aa39ccc9e

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 9e8d963c97980b7f12d7f6280567b3a41101560fc24d6c97678db36d3ea943a5
MD5 d8168abf72ae20c2997e6ce03918da7b
BLAKE2b-256 7f53982c574670b19d9abdff047ea074e086559e3abff399e0690a401b024629

See more details on using hashes here.

File details

Details for the file litellm-1.97.0rc1-cp310-cp310-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for litellm-1.97.0rc1-cp310-cp310-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 b71962198910155ea8fabd957c7df857fb91b750f08f63d2c4c69a35c4abc189
MD5 3652b8af966d40a1e8039884d5fe41c8
BLAKE2b-256 811a6bf86948bcf3bd38f60a189b7bdb9d9141db8bc2240e679179e912ce3a89

See more details on using hashes here.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page