LiteLLM TD LLM Proxy Provider

Custom LiteLLM provider for Treasure Data's LLM Proxy API.

Installation

pip install litellm-td-llm-provider

Quick Start

import litellm
from litellm_td_llm_provider import register_td_provider

# Register the TD provider
register_td_provider()

# Use with LiteLLM
response = litellm.completion(
    model="td/claude-sonnet-4-5",
    messages=[{"role": "user", "content": "Hello!"}],
    api_key="your-td-api-key",
    api_base="https://llm-proxy.us01.treasuredata.com"
)

Environment Variables

export TD_LLM_API_KEY="your-api-key"
export TD_LLM_SITE="us01"  # Optional, defaults to us01

Features

✅ Streaming support
✅ Async completion (acompletion)
✅ Tool calling support
✅ Multi-site support
✅ OpenAI-compatible interface

Documentation

For detailed documentation, examples, and development guide, visit: https://github.com/treasure-data-ai-labs/litellm-td-llm-provider

License

Apache License 2.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

litellm_td_llm_provider-0.1.2.tar.gz (12.8 kB view details)

Uploaded Mar 2, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

litellm_td_llm_provider-0.1.2-py3-none-any.whl (7.5 kB view details)

Uploaded Mar 2, 2026 Python 3

File details

Details for the file litellm_td_llm_provider-0.1.2.tar.gz.

File metadata

Download URL: litellm_td_llm_provider-0.1.2.tar.gz
Upload date: Mar 2, 2026
Size: 12.8 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for litellm_td_llm_provider-0.1.2.tar.gz
Algorithm	Hash digest
SHA256	`353aecdc964340888784d4ab7896f3a29ed20a0c15a6189d067f826083985456`
MD5	`0c27da980b048ea9504be4e7a8a67be1`
BLAKE2b-256	`e5f4edfbf3886b3179f1dfcc3334a6a098f6b951207cf3b39fcdc7856c3ae2dd`

See more details on using hashes here.

File details

Details for the file litellm_td_llm_provider-0.1.2-py3-none-any.whl.

File metadata

Download URL: litellm_td_llm_provider-0.1.2-py3-none-any.whl
Upload date: Mar 2, 2026
Size: 7.5 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for litellm_td_llm_provider-0.1.2-py3-none-any.whl
Algorithm	Hash digest
SHA256	`509303806c714477cfca81f58d1dc1ec9c0b2625ff157ff4eb4575958f4e76c0`
MD5	`ae7dbe5a81bf1c94ffd228a44a03cb47`
BLAKE2b-256	`626d0aaa2b122f9328332060277cf6e6c96333941d2a58404b707ff915cbebb3`