Agent Profiler

Profile and classify agent behavior patterns from traces using transition matrices and tool distributions.

Installation

pip install agent-profiler

Quick Start

Profile a Session

# Profile and classify behavior
aprof profile trace.jsonl

# Save results to JSON
aprof profile trace.jsonl -o results.json

Classify Behavior

aprof classify trace.jsonl

Generate Visualizations

aprof visualize trace.jsonl --output profile_chart.png

Programming API

from agent_profiler import AgentProfiler, BehaviorClassifier, ProfileVisualizer

# Profile a session
profiler = AgentProfiler()
result = profiler.profile("trace.jsonl")
print(f"Category: {result.category} (confidence: {result.confidence:.1%})")
print(f"Tool distribution: {result.tool_distribution.tool_counts}")

# Classify directly
classifier = BehaviorClassifier()
category, confidence, scores = classifier.classify(
    edit_ratio=0.25, read_ratio=0.15, bash_ratio=0.30,
    error_rate=0.4, error_recovery_rate=0.35
)

# Generate visualizations
visualizer = ProfileVisualizer()
visualizer.generate_profile_chart(result, output="profile.png")
visualizer.generate_transition_heatmap("trace.jsonl", output="heatmap.png")
visualizer.generate_tool_distribution_pie("trace.jsonl", output="tools.png")

Behavior Categories

License

MIT

Ecosystem

Part of the FableForge ecosystem — 21 open-source projects built from 210K real agent traces: