spyllm 0.2.2

Two-line automatic LLM tracing. Works with OpenAI, Anthropic, and more.

SpyLLM Python SDK

Automatic LLM tracing in two lines. Works with OpenAI, Anthropic, and more.

See it in action — view a live trace on the dashboard

Prerequisites

You need a free SpyLLM account and an API key to use this SDK.

1. Sign up at spyllm.dev/sign-up
2. Go to Settings → API Keys and click Create API Key
3. Copy the key — it is only shown once

Install

pip install spyllm

With provider extras:

pip install spyllm[openai]       # OpenAI
pip install spyllm[anthropic]    # Anthropic
pip install spyllm[otel]         # OpenTelemetry export

Quick Start

import spyllm

spyllm.init(api_key="sk-...")

# That's it. Every OpenAI and Anthropic call is now automatically traced.
from openai import OpenAI

client = OpenAI()
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}],
)
# Prompt, response, tokens, cost, and latency are captured automatically.

Open the dashboard to see traces as they arrive.

What Gets Captured

Every LLM call automatically records:

• Prompt — full message history sent to the model
• Response — the model's output
• Token count — input + output tokens
• Cost — estimated USD cost based on model pricing
• Latency — wall-clock time for the API call
• Tool calls — if the model invoked tools/functions
• Errors — failed calls with the exception message

Supported Providers

Provider	Auto-instrumented
OpenAI	Yes
Anthropic	Yes

Advanced Usage

Manual Tracing

from spyllm import SpyLLMClient

client = SpyLLMClient(api_key="sk-...", base_url="https://api.spyllm.dev")
client.trace(
    agent_name="my-agent",
    prompt="What is 2+2?",
    response="4",
    token_count=15,
    cost_usd=0.001,
)

Decorator

from spyllm import agent_trace, init

init(api_key="sk-...")

@agent_trace("my-pipeline")
def run_pipeline(query: str) -> str:
    # your code here
    return result

Disable Auto-instrumentation

spyllm.init(api_key="sk-...", instrument=False)

Self-hosted

Point the SDK at your own instance:

spyllm.init(api_key="sk-...", base_url="https://your-host.com")

Documentation

• Quickstart guide
• API reference

Changelog

See GitHub Releases for a full changelog.

License

MIT