litellm-td-llm-provider 0.1.2

LiteLLM provider for Treasure Data LLM Proxy

LiteLLM TD LLM Proxy Provider

Custom LiteLLM provider for Treasure Data's LLM Proxy API.

Installation

pip install litellm-td-llm-provider

Quick Start

import litellm
from litellm_td_llm_provider import register_td_provider

# Register the TD provider
register_td_provider()

# Use with LiteLLM
response = litellm.completion(
    model="td/claude-sonnet-4-5",
    messages=[{"role": "user", "content": "Hello!"}],
    api_key="your-td-api-key",
    api_base="https://llm-proxy.us01.treasuredata.com"
)

Environment Variables

export TD_LLM_API_KEY="your-api-key"
export TD_LLM_SITE="us01"  # Optional, defaults to us01

Features

• ✅ Streaming support
• ✅ Async completion (acompletion)
• ✅ Tool calling support
• ✅ Multi-site support
• ✅ OpenAI-compatible interface

Documentation

For detailed documentation, examples, and development guide, visit: https://github.com/treasure-data-ai-labs/litellm-td-llm-provider

License

Apache License 2.0