Skip to main content

Deterministic tests for AI agents: record a run once, replay it with zero LLM calls. Assert which tools an agent called, with which arguments, in which order.

Project description

flowproof

Run your AI agent once, keep the recording, and assert against it from then on. flowproof captures the run at the model boundary - every request and every tool-call decision - and serves it back on later runs, so replay makes zero LLM calls. You assert which tools were called, with which arguments, in which order, and which were not. The same engine drives web, desktop and Citrix.

Agents author, a deterministic engine executes. A flow is described in YAML with natural-language steps, recorded once against the live app, and replayed deterministically in CI with zero LLM calls. Built agent-native: every operation returns structured results a program can reason over, and agents can drive record/run/get_trace/heal over MCP (pip install flowproof[mcp], run flowproof-mcp).

# calc.flow.yaml
name: Add two numbers
app: calc
steps:
  - Type 5
  - Press plus
  - Type 3
  - Press equals
  - assert: display shows 8
from flowproof import Flow

flow = Flow("calc.flow.yaml")
flow.record()            # performs the flow live, writes the trace
result = flow.run()      # deterministic replay -> RunResult
assert result.passed

Or from the shell: flowproof record calc.flow.yaml, then flowproof run calc.flow.yaml (add --json for the structured report).

The wheel bundles the Rust engine; no separate install. Targets: web (headless Chromium, any OS), Windows desktop via UI Automation, sap (SAP GUI Scripting), vision (pixels-only for Citrix/RDP), and api (no UI — HTTP/SQL assertion flows, any OS).

Status: early, in active development (v0.2). Record→replay, model-grounded authoring, healing with reviewable diffs, suites, run recordings, and the MCP server all work and are tested in CI.

Docs and source: github.com/automators-com/flowproof

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flowproof-0.7.0.tar.gz (548.2 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

flowproof-0.7.0-cp39-abi3-win_amd64.whl (9.2 MB view details)

Uploaded CPython 3.9+Windows x86-64

flowproof-0.7.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.0 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.17+ x86-64

flowproof-0.7.0-cp39-abi3-macosx_11_0_arm64.whl (7.3 MB view details)

Uploaded CPython 3.9+macOS 11.0+ ARM64

File details

Details for the file flowproof-0.7.0.tar.gz.

File metadata

  • Download URL: flowproof-0.7.0.tar.gz
  • Upload date:
  • Size: 548.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for flowproof-0.7.0.tar.gz
Algorithm Hash digest
SHA256 d72a42a7968baee12d438d5acf8001974950309de9c2b9b11d33da6c021fb805
MD5 2f5be7871a44eab08546370b65e7cb77
BLAKE2b-256 d885e477a4bda0b2398a53f9a47826ca4ed3fe9f57bae0b7824e68fbdbd91226

See more details on using hashes here.

Provenance

The following attestation bundles were made for flowproof-0.7.0.tar.gz:

Publisher: publish.yml on automators-com/flowproof

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file flowproof-0.7.0-cp39-abi3-win_amd64.whl.

File metadata

  • Download URL: flowproof-0.7.0-cp39-abi3-win_amd64.whl
  • Upload date:
  • Size: 9.2 MB
  • Tags: CPython 3.9+, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for flowproof-0.7.0-cp39-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 059df59c7240ed81f82538d3c9aaa3797728cddce7840ad68bda73501a2493d5
MD5 f6b02f14da2d5d5557cd89e7dd370d30
BLAKE2b-256 40be534f608c515013ccf79624922e8392d9ce5791f5e18360ba8489de84eae0

See more details on using hashes here.

Provenance

The following attestation bundles were made for flowproof-0.7.0-cp39-abi3-win_amd64.whl:

Publisher: publish.yml on automators-com/flowproof

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file flowproof-0.7.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for flowproof-0.7.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d43e99cf1ecf2b2100a56c74eff405c7e8f6473d9021b27328edbe81aaf0e793
MD5 796a4837173e180c30fb36f183381580
BLAKE2b-256 a246e16153126bf921a6c2f5def2d20f9bb9830ce25e3462cb6f59ad9ff8fd81

See more details on using hashes here.

Provenance

The following attestation bundles were made for flowproof-0.7.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: publish.yml on automators-com/flowproof

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file flowproof-0.7.0-cp39-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for flowproof-0.7.0-cp39-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 52138db996ad32a92c6ede106628d3174c7b714923e5a67d90049dec1baa6c75
MD5 ce74e02e833038aad8de7510d1640244
BLAKE2b-256 02ecdde202a5f3523cd5b0454307adc71d4b70454b601e10307e835edfae327f

See more details on using hashes here.

Provenance

The following attestation bundles were made for flowproof-0.7.0-cp39-abi3-macosx_11_0_arm64.whl:

Publisher: publish.yml on automators-com/flowproof

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page