Palantyra 1.0.3

AI observability platform for LLM applications - Python SDK

Palantyra Python SDK

AI observability platform for LLM applications with automatic tracing.

Installation

pip install palantyra

For full functionality including async support and LLM client integrations:

pip install palantyra[full]

Quick Start

import palantyra

# Initialize once (like Laminar)
palantyra.initialize(api_key="your-api-key")

# All LLM calls are now automatically traced!
from openai import OpenAI
client = OpenAI()

response = client.chat.completions.create(
    model="gpt-4",
    messages=[{"role": "user", "content": "Hello!"}]
)
# ↑ This is automatically traced with cost, latency, tokens, etc.

Features

• Zero-code tracing: Just initialize and go
• Automatic cost tracking: Real-time cost calculation
• Performance monitoring: Latency, token usage, error rates
• Session correlation: Group related LLM calls
• Multi-provider support: OpenAI, Anthropic, and more
• Async support: Works with httpx, aiohttp
• Framework integration: FastAPI, Django, Flask examples

Usage Examples

Manual Tracing

@palantyra.trace("My AI Function")
def process_text(text):
    palantyra.add_attribute("input_length", len(text))

    # Your LLM calls here
    result = client.chat.completions.create(...)

    palantyra.add_attribute("output_length", len(result))
    return result

Session Tracking

with palantyra.trace("Document Analysis"):
    palantyra.add_attribute("session_id", "session_123")

    # Multiple related LLM calls
    summary = summarize_document(doc)
    questions = generate_questions(doc)
    answers = answer_questions(questions, doc)

Error Handling

try:
    response = client.chat.completions.create(...)
except Exception as e:
    palantyra.set_error(e)
    raise

Direct Proxy Usage

You can also use Palantyra as a proxy without the SDK:

import requests

response = requests.post(
    "http://localhost:8080/proxy/openai/v1/chat/completions",
    headers={"Authorization": "Bearer your-palantyra-api-key"},
    json={"model": "gpt-4", "messages": [...]}
)

Configuration

palantyra.initialize(
    api_key="your-api-key",
    base_url="http://localhost:8080",  # Palantyra server
    project_id="my-project",
    timeout=30.0
)

Web Framework Integration

FastAPI

from fastapi import FastAPI
import palantyra

app = FastAPI()

@app.on_event("startup")
async def startup():
    palantyra.initialize(api_key="your-key")

@app.post("/chat")
async def chat(message: str):
    with palantyra.trace("Chat API"):
        # Your LLM logic here
        return {"response": "..."}

Django

# settings.py
MIDDLEWARE = [
    'myapp.middleware.PalantyraMiddleware',
    # ... other middleware
]

# middleware.py
import palantyra

class PalantyraMiddleware:
    def __init__(self, get_response):
        self.get_response = get_response
        palantyra.initialize(api_key="your-key")

    def __call__(self, request):
        with palantyra.trace(f"{request.method} {request.path}"):
            return self.get_response(request)

Documentation

• Full Documentation
• API Reference
• Examples

License

MIT License