Agent Playbook 🔬

The Storybook for AI Agents - Build, test, and showcase your pydantic-ai agents in an interactive playground.

🎯 Motivation

Building AI agents is hard. Testing them is even harder.

When developing UI components, tools like Storybook revolutionized the workflow by providing an isolated environment to build, test, and showcase components. Agent Playbook brings this same philosophy to AI agent development.

The Problem

• Slow iteration cycles - Running agents in full applications slows down development
• Hard to debug - Understanding agent behavior, tool calls, and decision-making is opaque
• Difficult to demonstrate - Showing agent capabilities to stakeholders requires complex setups
• No organized testing - Agents scattered across codebases without a unified testing environment

The Solution

Agent Playbook automatically discovers your pydantic-ai agents, loads them into an interactive web playground, and lets you test, debug, and showcase them in real-time with full visibility into their thinking process and tool executions.

✨ Key Features

• 🔍 Auto-Discovery - Automatically finds and loads agents from your codebase
• 🎮 Interactive Playground - Beautiful web UI for testing agents in real-time
• 🔄 Streaming Support - Watch agent responses, thinking, and tool calls as they happen
• 🧩 Scenario Configuration - Test agents with different configurations
• 🛠️ Tool Visualization - See exactly what tools agents call with arguments and results

🚀 Quick Start

Installation

pip install agent-playbook

(The CLI command is playbook, not agent-playbook)

Basic Example

Step 1: Define your agent (support_agent.py)

from pydantic_ai import Agent, RunContext
from pydantic import BaseModel


class SupportDeps(BaseModel):
    company_name: str
    support_email: str


support_agent = Agent(model="openai:gpt-4", deps_type=SupportDeps)


@support_agent.system_prompt
async def support_system_prompt(ctx: RunContext[SupportDeps]) -> str:
    return f"You are a helpful customer support agent for {ctx.deps.company_name}."


@support_agent.tool
async def check_order_status(ctx: RunContext[SupportDeps], order_id: str) -> str:
    """Check the status of a customer order."""
    return f"Order {order_id} is being processed and will ship in 2-3 business days."


@support_agent.tool
async def create_ticket(ctx: RunContext[SupportDeps], issue: str, priority: str) -> str:
    """Create a support ticket."""
    return f"Ticket created with {priority} priority. Contact: {ctx.deps.support_email}"

Step 2: Export scenarios (support_agent__scenarios.py)

Agent Playbook auto-discovers modules ending with __scenarios and registers the agents. Use the export() function to define different configurations:

from agent_playbook import export
from .support_agent import SupportDeps, support_agent

export(
    agent=support_agent,
    scenarios=[
        {
            "name": "ACME Corp",
            "settings": SupportDeps(
                company_name="ACME Corporation", support_email="support@acme.com"
            ),
        },
        {
            "name": "TechStart",
            "settings": SupportDeps(
                company_name="TechStart Inc", support_email="help@techstart.io"
            ),
        },
    ],
)

Start the server and open http://localhost:8765:

playbook myapp.agents --reload

🛠️ CLI Reference

playbook <package> [options]

Options:
  --host TEXT      Server host (default: 127.0.0.1)
  --port INTEGER   Server port (default: 8765)
  --reload         Auto-reload on code changes

🤝 Contributing

Contributions are welcome! Fork the repository, create a feature branch, and submit a Pull Request.

📄 License

Licensed under AGPL-3.0. See LICENSE for details.