Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.2.1.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.2.1-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.2.1.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.2.1.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.2.1.tar.gz
Algorithm Hash digest
SHA256 54ee42ff362c3dcebd88e23e3e2040ec702d7ff221a50a5aaa89e3986c7ce02c
MD5 861e43735158c516772a4dea88f39ec7
BLAKE2b-256 9de938a3022c8247175f02f3cf4023b8b3917fdb91fb9e85b43d3e2eacc0f608

See more details on using hashes here.

File details

Details for the file agentforge_testing-0.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 5f7ab058c49fe6515f225487bdf9275aeae72a90f91dfdf030a5bc5664677800
MD5 d82dae3229dad85e13813f3c20051309
BLAKE2b-256 67eff6a806508aeab03b05f539ab4728dbc3798e3950e007d9972652d030e866

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page