LiteLLM TD LLM Proxy Provider
Custom LiteLLM provider for Treasure Data's LLM Proxy API.
Installation
pip install litellm-td-llm-provider
Quick Start
import litellm
from litellm_td_llm_provider import register_td_provider
# Register the TD provider
register_td_provider()
# Use with LiteLLM
response = litellm.completion(
model="td/claude-sonnet-4-5",
messages=[{"role": "user", "content": "Hello!"}],
api_key="your-td-api-key",
api_base="https://llm-proxy.us01.treasuredata.com"
)
Environment Variables
export TD_LLM_API_KEY="your-api-key"
export TD_LLM_SITE="us01" # Optional, defaults to us01
Features
- ✅ Streaming support
- ✅ Async completion (
acompletion) - ✅ Tool calling support
- ✅ Multi-site support
- ✅ OpenAI-compatible interface
Documentation
For detailed documentation, examples, and development guide, visit: https://github.com/treasure-data-ai-labs/litellm-td-llm-provider
License
Apache License 2.0
Metadata
Release files for litellm-td-llm-provider 0.1.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| litellm_td_llm_provider-0.1.2.tar.gz | 12.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| litellm_td_llm_provider-0.1.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 20.3 kB
Release files / litellm_td_llm_provider-0.1.2.tar.gz
| Download URL | litellm_td_llm_provider-0.1.2.tar.gz |
|---|---|
| Size | 12.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
353aecdc964340888784d4ab7896f3a29ed20a0c15a6189d067f826083985456
|
|
BLAKE2b-256 checksum How to use checksums |
e5f4edfbf3886b3179f1dfcc3334a6a098f6b951207cf3b39fcdc7856c3ae2dd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litellm_td_llm_provider-0.1.2-py3-none-any.whl
| Download URL | litellm_td_llm_provider-0.1.2-py3-none-any.whl |
|---|---|
| Size | 7.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
509303806c714477cfca81f58d1dc1ec9c0b2625ff157ff4eb4575958f4e76c0
|
|
BLAKE2b-256 checksum How to use checksums |
626d0aaa2b122f9328332060277cf6e6c96333941d2a58404b707ff915cbebb3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.7 {"installer":{"name":"uv","version":"0.10.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|