Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.3.0.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.3.0-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.3.0.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.3.0.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.3.0.tar.gz
Algorithm Hash digest
SHA256 29a3fa78070a0d88647872ebcb16930dc42fe48b11e42b6cff1a89c0b9fbcdf6
MD5 9d8ee727afd3eb98e5e7cda2c7e1b115
BLAKE2b-256 fc93a1fd4a1d0916c748887fe2a1f27d0ea0d76533696e5be9985adf54068690

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentforge_testing-0.3.0.tar.gz:

Publisher: release.yml on Scaffoldic/agentforge-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agentforge_testing-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 17e204b78d60138f907aab5810ac0e5be0dae01b08976610db1053ef85b518b5
MD5 2b80974c63caa5a50a0d15b34f75b29f
BLAKE2b-256 1a34768eeaad3e2aef378da83024aea8cba7160a6619e3f75e6ca4daff45f75b

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentforge_testing-0.3.0-py3-none-any.whl:

Publisher: release.yml on Scaffoldic/agentforge-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page