Skip to main content

AgentMetrics observability integration for OpenAI Agents SDK

Project description

agentmetrics-openai-agents

PyPI License: MIT

AgentMetrics integration for the OpenAI Agents SDK. Register one trace processor at startup and every agent run reports back to your dashboard showing latency, cost, token counts, tool calls, and errors, with zero changes to your agent code.


Install

pip install agentmetrics-openai-agents

Quickstart

from agents.tracing import add_trace_processor
from agentmetrics_openai_agents import AgentMetricsProcessor

# register once at startup, covers all agents in the process
add_trace_processor(AgentMetricsProcessor(
    agent_id="my-openai-agent",
    base_url="http://localhost:8099",
))

# Run your agents as normal
result = await Runner.run(my_agent, "Summarize this document")

API

AgentMetricsProcessor(agent_id, base_url)

Parameter Default Description
agent_id "openai-agent" Fallback label if the trace has no name attribute
base_url "http://localhost:8099" AgentMetrics server address

Implements TracingProcessor from agents.tracing. Pass to add_trace_processor() before running any agents.

.force_flush()

Blocks until all in-flight HTTP requests complete.

.shutdown()

Calls force_flush(). Called automatically when the process exits cleanly.


What gets tracked

Each agent trace emits one event to /v1/events when on_trace_end fires:

Field Description
status success or failed
duration_ms Wall-clock trace duration
input_tokens / output_tokens Aggregated from all LLMSpanData spans
cache_read_tokens / cache_write_tokens Cache token counts
llm_calls Number of LLM spans in the trace
tool_calls / tool_errors Counts from FunctionSpanData spans
tool_names Set of function/tool names
model Model name from the first LLM span output
estimated_cost_usd Computed from token counts and model pricing
error First 500 chars of the trace error on failure

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentmetrics_openai_agents-0.2.0.tar.gz (4.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentmetrics_openai_agents-0.2.0-py3-none-any.whl (4.9 kB view details)

Uploaded Python 3

File details

Details for the file agentmetrics_openai_agents-0.2.0.tar.gz.

File metadata

File hashes

Hashes for agentmetrics_openai_agents-0.2.0.tar.gz
Algorithm Hash digest
SHA256 cd319cbd51600b478601277b7120e71e5359d6aa3e6567936941b1e9648202d6
MD5 6bd74fe5fcb6de479a89a824c8165b90
BLAKE2b-256 f4b7c64fffbbe8d903ce4f44bed1681fbcf84ffa3e49cfb694339ba4b46360f6

See more details on using hashes here.

File details

Details for the file agentmetrics_openai_agents-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for agentmetrics_openai_agents-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a32a3f0f51262993bca42595f28f91feff34c544e48c12fb10c65aa97b51dc21
MD5 904b169a97ddba463f70329e57d61149
BLAKE2b-256 88df8df88af81123c0db28f6825d09424efe9d7e2403b1ecb0d4d40fd1091d52

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page