Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.2.3.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.2.3-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.2.3.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.2.3.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.2.3.tar.gz
Algorithm Hash digest
SHA256 eff67e8c1fbe8d5424fdeceb348e60a0336677ca2d2276ec016bd4b75cf5cb82
MD5 756a350fe2ec416a2e0067c6393249e7
BLAKE2b-256 10ed282ea98624ba8550ce5fbfdcaa20fe3175ce402c66e101a878b43dce0285

See more details on using hashes here.

File details

Details for the file agentforge_testing-0.2.3-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 9eeecfc3a8a61f929932e6dce3b417b8f7199d82e5899b4653e3dbaefe24b194
MD5 75a1f866007cdec68a2939afdf9b6b54
BLAKE2b-256 4c2d8baac1d2808b8c4df5d414647f51584f04b0eec8b4d9d0553f130da8675a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page