Skip to main content

Deterministic replay harness for agent tool-call traces.

Project description

tool-call-replay

tool-call-replay turns agent tool-call traces into deterministic local replay artifacts and pytest regression tests. It helps agent teams convert production failures into reviewable test cases without live model calls or live tool execution.

Quickstart

python -m venv .venv
. .venv/bin/activate
pip install tool-call-replay
tool-call-replay ingest examples/failed_refund_agent_trace.jsonl --out replay.json
tool-call-replay run replay.json --assert examples/refund_assertions.yaml
tool-call-replay pytest replay.json --assert examples/refund_assertions.yaml --out test_refund_agent_replay.py

Supported Inputs

  • simple JSONL traces;
  • OpenAI-style event traces;
  • OTLP/GenAI span exports;
  • Phoenix-like JSON exports.

The v1 importers normalize all inputs into a canonical ToolCallReplay JSON object.

What This Is Not

This is not an agent framework and does not call models, tools, or provider APIs. It replays recorded tool-call structure and mocked outputs so failures can become deterministic tests.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tool_call_replay-0.1.0.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tool_call_replay-0.1.0-py3-none-any.whl (11.1 kB view details)

Uploaded Python 3

File details

Details for the file tool_call_replay-0.1.0.tar.gz.

File metadata

  • Download URL: tool_call_replay-0.1.0.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for tool_call_replay-0.1.0.tar.gz
Algorithm Hash digest
SHA256 f57e1bace1180d64b215b02bb3df71dea5f265bf8539bdb25798be880c05228c
MD5 dc3ecd2f543351910d6adc367e703c4f
BLAKE2b-256 4796ec6dd24b753f45b97861d98370e65e1006b9f66fbde8817da8533f0af4a5

See more details on using hashes here.

File details

Details for the file tool_call_replay-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for tool_call_replay-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b082df5c39deac409b15b79f2874bde40c1318b27071f23f97250ba2c2ded708
MD5 5b7d372d77a4ddbd67e9157b20360cba
BLAKE2b-256 c561ecac89709c6835517c867ed4bef9fcd66a3b398fb68ccea7edc27d3b8d64

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page