Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.2.2.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.2.2-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.2.2.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.2.2.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.2.2.tar.gz
Algorithm Hash digest
SHA256 2e48b7c033401640a540f971bd1f2d2d17062119c731e3e0f6180ab4010c3bcd
MD5 51efeb6a1ed7c4d105cfb885502e65fb
BLAKE2b-256 1e34e52c61f37d6ec6f6caac8a923a8a076155e332960925fde32d2f477f5cf0

See more details on using hashes here.

File details

Details for the file agentforge_testing-0.2.2-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 88f912708bf3933f61a218467909072bffc0c809d13becaa63dc9a3571e2ac47
MD5 ea1ee12f9c065c713bd30a654e54d9be
BLAKE2b-256 53f74945832bfbd0e5debcbb5a6e603549e06219191e3fb989a1e022b1b8289a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page