Skip to main content

Lightweight, local-first observability and debugging for Python AI agents.

Project description

PeekAI

Lightweight, local-first observability and debugging for Python AI agents.

No cloud. No API keys. No dashboards to sign up for.
Drop it in, call peekai.init(), and see exactly what your agent is doing —
every LLM call, every tool use, every token spent.

Python License Status uv


Why PeekAI?

Building AI agents is hard. Debugging them is harder. Tools like LangSmith or Weights & Biases require you to send your data to their cloud, create accounts, and wire up pipelines before you can see a single trace.

PeekAI is different:

🏠 Local-first All traces stored in SQLite at ~/.peekai/peekai.db — nothing leaves your machine
Zero config One line to instrument OpenAI, Anthropic, and LiteLLM
🧠 Multi-agent aware Visualize agent-to-agent handoffs as a nested span tree
🔁 Trace replay Re-run any past trace with a different model or modified tool response
🖥️ CLI + UI Inspect traces in your terminal or a local Streamlit dashboard

Install

pip install peekai

# With OpenAI support
pip install "peekai[openai]"

# With Anthropic support
pip install "peekai[anthropic]"

# With the web dashboard
pip install "peekai[ui]"

# With everything
pip install "peekai[all]"

Quickstart

import peekai
from openai import OpenAI

# One line to instrument everything
peekai.init()

client = OpenAI()

response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "What is 2 + 2?"}],
)

print(response.choices[0].message.content)

Then inspect your traces:

peekai list                  # recent traces
peekai view <trace-id>       # full span waterfall
peekai stats                 # token + cost totals
peekai ui                    # launch the web dashboard

How it workspeekai.init() monkey-patches the SDK clients at startup. No changes to your existing API calls are needed.


Multi-Agent Support

Decorate your agents and tools — PeekAI automatically builds the parent/child span tree:

import peekai
from openai import OpenAI

peekai.init()
client = OpenAI()


@peekai.agent("researcher")
def researcher_agent(topic: str) -> str:
    response = client.chat.completions.create(
        model="gpt-4o",
        messages=[{"role": "user", "content": f"Research: {topic}"}],
    )
    return response.choices[0].message.content


@peekai.agent("writer")
def writer_agent(research: str) -> str:
    response = client.chat.completions.create(
        model="gpt-4o",
        messages=[{"role": "user", "content": f"Summarise: {research}"}],
    )
    return response.choices[0].message.content


@peekai.tool("format_output")
def format_output(text: str) -> str:
    return f"📝 {text}"


@peekai.trace("multi_agent_pipeline")
def run():
    research = researcher_agent("the James Webb Space Telescope")
    summary = writer_agent(research)
    return format_output(summary)


run()

Visualize the agent flow in the terminal:

peekai map <trace-id>
  trace: multi_agent_pipeline  ✓ ok  3.6s  236 tokens  $0.000222

  └── 🧠 researcher  [agent]  ✓ ok  2.3s
      └── 🤖 openai/gpt-4o  [llm]  ✓ ok  2.3s  102 tok  $0.000115
  └── 🧠 writer  [agent]  ✓ ok  1.3s
      └── 🤖 openai/gpt-4o  [llm]  ✓ ok  1.3s  134 tok  $0.000107
  └── 🔧 format_output  [tool]  ✓ ok  0ms

Trace Replay

Re-run any past trace — swap the model, inject a different tool response, see what would have changed:

# Replay with the same model
peekai replay <trace-id>

# Swap to a different model
peekai replay <trace-id> --model gpt-4o

# Swap to Anthropic
peekai replay <trace-id> --model claude-3-5-sonnet-20241022

# Inject a modified tool response
peekai replay <trace-id> --tool search="different search result"

The replay is saved as a new trace and shown side by side in the UI with token/cost deltas.


CLI Reference

Command Description
peekai list Show last 10 traces
peekai view <id> Full span waterfall with I/O
peekai stats Total runs, tokens, cost by model
peekai map <id> ASCII agent flow tree
peekai replay <id> Re-run a trace (supports --model, --tool)
peekai ui Launch Streamlit dashboard
peekai clear Wipe local storage

All commands accept short trace IDs — the first 8 characters are enough.


Web Dashboard

peekai ui

Opens at http://localhost:8501 with four pages:

  • Dashboard — KPIs, cost over time, per-model breakdown
  • Traces — filterable list with status, tokens, cost
  • Trace View — span waterfall with duration bars, input/output tabs, error highlighting
  • Replay — run a replay with model swap, side-by-side comparison

Decorators

Decorator What it does
@peekai.trace("name") Wraps a function as a top-level trace
@peekai.agent("name") Wraps a sub-agent — its LLM calls become children in the tree
@peekai.tool("name") Wraps a tool call as a TOOL span

peekai.init() options

peekai.init(
    db_path="./my_traces.db",  # default: ~/.peekai/peekai.db
    openai=True,               # patch OpenAI SDK (default True)
    anthropic=True,            # patch Anthropic SDK (default True)
    litellm=True,              # patch LiteLLM (default True)
)

Traces are stored locally at ~/.peekai/peekai.db by default. You can open it directly with any SQLite viewer, back it up, or wipe it with peekai clear.


Supported SDKs

SDK Status Notes
OpenAI ✅ Auto-patched sync + async, streaming
Anthropic ✅ Auto-patched sync + async, create(stream=True)
LiteLLM ✅ Auto-patched sync + async

Note — the Anthropic client.messages.stream() context manager helper is not currently patched. Use client.messages.create(stream=True) to get streaming traces.


Development

# Clone and install
git clone https://github.com/peekai/peekai
cd peekai
uv sync --extra all  # includes openai, anthropic, litellm, ui

# Run tests
uv run pytest tests/ -v

# Run the demos
uv run python examples/demo_agent.py
uv run python examples/demo_multi_agent.py

# Launch the UI
uv run peekai ui

Roadmap

Feature Status
Core SDK — tracing, storage, patches ✅ Done
CLI — list, view, stats, clear, map ✅ Done
Streamlit UI — dashboard, traces, waterfall ✅ Done
Trace Replay — model swap, tool override ✅ Done
Multi-Agent — nested spans, agent decorator ✅ Done
v0.1 Public Release 🔵 In Progress

Contributing

# Install dev dependencies
uv sync --extra dev

# Run linter
uv run ruff check src/

# Run type checker
uv run mypy src/

# Run tests
uv run pytest tests/ -v

PRs and issues are welcome. See CONTRIBUTING.md for more detail.


License

MIT © Oussema Khorchani

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

peekai-0.1.0.tar.gz (677.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

peekai-0.1.0-py3-none-any.whl (459.8 kB view details)

Uploaded Python 3

File details

Details for the file peekai-0.1.0.tar.gz.

File metadata

  • Download URL: peekai-0.1.0.tar.gz
  • Upload date:
  • Size: 677.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for peekai-0.1.0.tar.gz
Algorithm Hash digest
SHA256 660e891b6021eb586e4b34cca9f00d6c0075a43c0657baff0553cc347b76973e
MD5 9b9a75359d0aaed61557603568983a05
BLAKE2b-256 75a24f6da9f967a19a2a853cf8f8c43087658d3acbb966f3005f98352b4b3257

See more details on using hashes here.

Provenance

The following attestation bundles were made for peekai-0.1.0.tar.gz:

Publisher: publish.yml on oussamaKH63/peekai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file peekai-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: peekai-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 459.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for peekai-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ce8bd7dc5aa6ed89ae26d37ec33dfb1d8a110c0dc7e6338dabf6bbb18ca454f7
MD5 2c7ba4c90763613510b5ded0499e210e
BLAKE2b-256 87786aa86d95d14f29c6c950c17605bd58d246eb38578e99a9b0a0354f7de1a8

See more details on using hashes here.

Provenance

The following attestation bundles were made for peekai-0.1.0-py3-none-any.whl:

Publisher: publish.yml on oussamaKH63/peekai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page