Skip to main content

Richer test helpers for AgentForge (golden-set runner, snapshot, recording analysis)

Project description

agentforge-testing

Richer test helpers for AgentForge agents. Pip-installable separately so the dependency doesn't land in production.

The lighter built-in surface — MockLLMClient, FakeTool, agent_factory, conformance harnesses, record_llm / MockLLMClient.from_recording — ships inside the agentforge runtime package at agentforge.testing. Install this package when you want, additionally:

  • GoldenSetRunner — load JSONL fixtures, run an agent, compare output via structural diff with allow-listed wildcards.
  • assert_snapshot(actual, path) — Approval-style snapshot file helper with UPDATE_SNAPSHOTS=1 re-record.
  • analyze_recording(path) — stats about a captured cassette (call count, token totals, distinct tool calls, per-step latency distribution).
uv add --dev agentforge-testing

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentforge_testing-0.2.4.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentforge_testing-0.2.4-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file agentforge_testing-0.2.4.tar.gz.

File metadata

  • Download URL: agentforge_testing-0.2.4.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentforge_testing-0.2.4.tar.gz
Algorithm Hash digest
SHA256 d659aa3693df1cb103732d0cd1affa5f2b2c1e2650d0734b7daef4c89992dffd
MD5 6f808555bbb8107f0d23f2b0f0b8671d
BLAKE2b-256 e0f75eae9ef7e5b4218b8b5cae23efd4b0e3223c5e57a49b3a091319af873ef7

See more details on using hashes here.

File details

Details for the file agentforge_testing-0.2.4-py3-none-any.whl.

File metadata

File hashes

Hashes for agentforge_testing-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 84426dbf18a161042844d8a0b92c300bfa8a98fe56a0a16089ed14c4f735470d
MD5 3b99407eedd29aa03ea97bb4f970d56f
BLAKE2b-256 b0772b36de817abe9586beb95a0869cefaa629b3305b7802516ac561d6762ea3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page