respan-exporter-litellm 1.0.0

Respan exporter for LiteLLM

Keywords AI LiteLLM Exporter

LiteLLM integration for exporting logs and traces to Keywords AI.

Installation

pip install keywordsai-exporter-litellm

Quick Start

Callback Mode

Use the callback to send traces to Keywords AI:

import litellm
from keywordsai_exporter_litellm import KeywordsAILiteLLMCallback

# Setup callback
callback = KeywordsAILiteLLMCallback(api_key="your-keywordsai-api-key")
callback.register_litellm_callbacks()

# Make LLM calls - traces are automatically sent
response = litellm.completion(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
)

Proxy Mode

Route requests through Keywords AI gateway:

import litellm

response = litellm.completion(
    api_key="your-keywordsai-api-key",
    api_base="https://api.keywordsai.co/api",
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
)

Logging

If you just want individual logs (no trace/span IDs), omit trace fields and send only basic metadata. This will produce one log per request.

Callback Mode (with keywordsai_params)

import litellm
from keywordsai_exporter_litellm import KeywordsAILiteLLMCallback

callback = KeywordsAILiteLLMCallback(api_key="your-api-key")
callback.register_litellm_callbacks()

response = litellm.completion(
    api_key="your-api-key",
    api_base="https://api.keywordsai.co/api",
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
    metadata={
        "keywordsai_params": {
            "workflow_name": "simple_logging",
            "span_name": "single_log",
            "customer_identifier": "user-123",
        }
    },
)

Proxy Mode (with extra_body)

import litellm

response = litellm.completion(
    api_key="your-keywordsai-api-key",
    api_base="https://api.keywordsai.co/api",
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
    extra_body={
        "span_workflow_name": "simple_logging",
        "span_name": "single_log",
        "customer_identifier": "user-123",
    },
)

License

MIT