Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.3.1.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.3.1-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.3.1.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.3.1.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.3.1.tar.gz
Algorithm Hash digest
SHA256 459217eeda18615c0254c37be3f4b8dd92b6ee756f220d8f2e8d3d789fa63795
MD5 b6d3da7ba6b3bcd5d08cefb8aeeb2854
BLAKE2b-256 4f348c1f92f51fe6a2334d8d4c43e285aae30a97b83a0e3e6989410ff23287a1

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentforge_testing-0.3.1.tar.gz:

Publisher: release.yml on Scaffoldic/agentforge-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agentforge_testing-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4320aaf6a49192015dc5100fcca32e793887588aa4dff63bea1ef6cc5f00de4e
MD5 c059db9455065db90039edf38bd6f397
BLAKE2b-256 06ae34db9aa9c13d47d70a4e9e34b2357447eef08719201f8aaabf3162e8ab22

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentforge_testing-0.3.1-py3-none-any.whl:

Publisher: release.yml on Scaffoldic/agentforge-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page