Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.4.0.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.4.0-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.4.0.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.4.0.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.4.0.tar.gz
Algorithm Hash digest
SHA256 949f321317beddc6f930ebdba017180752259b5540b548480420e9750441d3d8
MD5 8e0f958588c4c9fe609eca345fdd6c19
BLAKE2b-256 7d888ff88a0cfb7e50afec738eed6484bc0793f9b61928a313521fffb162d3f9

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentforge_testing-0.4.0.tar.gz:

Publisher: release.yml on Scaffoldic/agentforge-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agentforge_testing-0.4.0-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1c57e6ba538c76256afabac750a13e802342636657b25f4d528565a1f3676504
MD5 a26974d572c8f48600a2aa430effd3f6
BLAKE2b-256 72e425b5cc49f24d29aaf3260c78ecd8b9ea52437235993f10489f740aad96b9

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentforge_testing-0.4.0-py3-none-any.whl:

Publisher: release.yml on Scaffoldic/agentforge-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page