Skip to main content

LiteLLM TD LLM Proxy Provider

Python PyPI CI status

Custom LiteLLM provider for Treasure Data's LLM Proxy API.

Installation

pip install litellm-td-llm-provider

Quick Start

import litellm
from litellm_td_llm_provider import register_td_provider

# Register the TD provider
register_td_provider()

# Use with LiteLLM
response = litellm.completion(
    model="td/claude-sonnet-4-5",
    messages=[{"role": "user", "content": "Hello!"}],
    api_key="your-td-api-key",
    api_base="https://llm-proxy.us01.treasuredata.com"
)

Environment Variables

export TD_LLM_API_KEY="your-api-key"
export TD_LLM_SITE="us01"  # Optional, defaults to us01

Features

  • ✅ Streaming support
  • ✅ Async completion (acompletion)
  • ✅ Tool calling support
  • ✅ Multi-site support
  • ✅ OpenAI-compatible interface

Documentation

For detailed documentation, examples, and development guide, visit: https://github.com/treasure-data-ai-labs/litellm-td-llm-provider

License

Apache License 2.0

Metadata

Release files for litellm-td-llm-provider 0.1.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for litellm-td-llm-provider 0.1.2
File Size Uploaded
litellm_td_llm_provider-0.1.2.tar.gz 12.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for litellm-td-llm-provider 0.1.2
File Interpreter ABI Platform
litellm_td_llm_provider-0.1.2-py3-none-any.whl Python 3 none any Details

Total release size: 20.3 kB

Release files / litellm_td_llm_provider-0.1.2.tar.gz

Download URL litellm_td_llm_provider-0.1.2.tar.gz
Size 12.8 kB
Tags Source
SHA-256 checksum
How to use checksums
353aecdc964340888784d4ab7896f3a29ed20a0c15a6189d067f826083985456
BLAKE2b-256 checksum
How to use checksums
e5f4edfbf3886b3179f1dfcc3334a6a098f6b951207cf3b39fcdc7856c3ae2dd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / litellm_td_llm_provider-0.1.2-py3-none-any.whl

Download URL litellm_td_llm_provider-0.1.2-py3-none-any.whl
Size 7.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
509303806c714477cfca81f58d1dc1ec9c0b2625ff157ff4eb4575958f4e76c0
BLAKE2b-256 checksum
How to use checksums
626d0aaa2b122f9328332060277cf6e6c96333941d2a58404b707ff915cbebb3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

This release

0.1.2 This release

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page