Skip to main content

Compound-path and cross-release analysis of what an AI agent is permitted to do

Project description

AgentMandate

Compound-path and cross-release analysis of what an AI agent is permitted to do.

PyPI Python 3.10+ CI Coverage: 90%+ License: Apache-2.0

Analyse what an AI agent is permitted to do, and what changed between two releases.

Agent security scanners check tools one at a time. That catches the tool with no approval gate and the one running as a service account, which is worth catching. It misses the defect where every tool passes review and a legal sequence of them does not.

AgentMandate answers two questions that need the whole graph:

  • Is there a legal call sequence that breaches a limit, or that reaches an irreversible effect with no approval? mandate reach returns the sequence.
  • Did this release widen what the agent can reach? mandate diff compares effective authority, not configuration text.

Alpha. Apache-2.0.

Try it

pip install "agentmandate[yaml]"

A payment-dispute agent. Refunds are capped at 500 GBP per case, every refund is gated by human approval, the run limit is 500 GBP, nothing spends a service account. It passes:

$ mandate lint examples/dispute-resolver.yaml
no single-manifest findings

$ mandate reach examples/dispute-resolver.yaml
no reachable breach within depth 8. 3 tool(s) reachable, most extractable 500 GBP

Now release v2, which adds one read-only tool so the agent can find existing cases instead of always opening a new one. It reads. It writes nothing. It goes through review as a read-only addition:

  - name: search_cases
    effect: read
    produces: case
    unbounded: true
$ mandate lint examples/dispute-resolver-v2.yaml
no single-manifest findings

$ mandate reach examples/dispute-resolver-v2.yaml
BREACH  cumulative value 1000 GBP exceeds limit 500 GBP
  1. open_case(case#1)
  2. search_cases(case#2)
  3. issue_refund(case#1, 500 GBP)
  4. issue_refund(case#2, 500 GBP)

The lint is still clean, because no single tool is wrong. The ceiling was measured against a case, and the new tool lets the agent obtain cases at will, so the ceiling now bounds nothing. In CI:

$ mandate diff examples/dispute-resolver.yaml examples/dispute-resolver-v2.yaml
authority diff  v1 -> v2
  + tool: gained search_cases
  + extractable value: 500 -> 2000 GBP
  + reachable breach: gained cumulative_value

verdict: WIDENING
a widening change needs named review before release

Exit code 1. The config diff was five lines and read-only. The authority diff was four times the money.

Why a config diff is not an authority diff

A pull request shows what somebody typed. It does not show what the agent can now do, because reachability composes and text does not. Adding a read tool, relaxing an enum in a schema, or removing one precondition can each open a path that did not exist, and none of them look like a permission change in review.

That is the same reason git diff never replaced type checking. The question is not what changed, it is what the change makes possible.

Starting from an existing agent

You do not have to write the first manifest by hand:

$ mandate scan examples/mcp-tools.json --agent dispute-resolver > mandate.yaml

The skeleton is loadable straight away, and every judgement the catalogue could not supply is marked:

  - name: issue_refund
    # REVIEW: effect guessed from the name. read | write | irreversible
    effect: irreversible
    # REVIEW: does this spend the caller's authority or a service account?
    principal: caller
    requires: [case]
    # REVIEW: amount looks like a value argument. A ceiling needs scope_key too.
    # value_arg: amount
    # scope_key: case
    # ceiling: { amount: 0, currency: GBP }
    requires_approval: true

Unrecognised verbs are proposed as irreversible, because under-calling an effect is the more expensive mistake.

The manifest

Reachability needs three facts per tool that an ordinary tool schema does not carry: the effect class, which argument spends value, and which scope the ceiling is measured against.

version: 1
agent: dispute-resolver
identity: spiffe://bank/agents/dispute-resolver

limits:
  total: { amount: 500, currency: GBP }
  depth: 8

tools:
  - name: open_case
    effect: read              # read | write | irreversible
    produces: case            # mints a binding of scope "case"

  - name: issue_refund
    effect: irreversible
    principal: caller         # caller | service
    requires: [case]
    value_arg: amount
    scope_key: case           # the ceiling is per case
    ceiling: { amount: 500, currency: GBP }
    requires_approval: true

Asking for full preconditions and postconditions would be more expressive and would not get written. This is the minimum that makes compound analysis possible.

A ceiling is the maximum cumulative value one tool may spend against one binding of its scope_key. unbounded: true marks a tool that can be called repeatedly to mint fresh bindings, which is what turns a per-scope ceiling into no ceiling at all.

Commands

Command What it does
mandate scan Derives a manifest skeleton from an MCP tools/list catalogue, with a REVIEW marker on every guess
mandate lint Single-manifest control checks: separation of duties, ungated irreversible effects, service-account principals, ceilings scoped to nothing
mandate reach Bounded search for a legal call sequence that breaches a limit, reported as a counterexample
mandate diff Effective-authority comparison of two manifests, classified widening / narrowing / neutral. --record emits a change record
mandate verify Replays recorded tool calls against the manifest and reports where reality exceeded the declaration

Every analysis command takes --json and exits non-zero on a finding, so they drop into CI unchanged. scan writes a manifest to standard output and is a one-off, not a gate.

Exit code Meaning
0 Clean
1 A finding: lint error, reachable breach, widening diff, or a non-conformant replay
2 Usage error or a malformed manifest

In a pull request, the useful gate is diff against the manifest on the default branch, so a change that widens authority stops and gets a named reviewer:

- name: Authority diff
  run: |
    git show origin/main:mandate.yaml > /tmp/released.yaml
    mandate diff /tmp/released.yaml mandate.yaml

verify is what keeps the rest honest. A manifest nobody checks is a wish, and the declaration drifts from the implementation the moment someone ships a connector change.

Where it fits, and what already exists

This is analysis, not enforcement. It runs in CI against a manifest, it does not sit in the request path.

AgentWard is a runtime proxy that enforces policy on each call and can diff two policy files. AgentShield scans agent configuration and MCP servers, with a drift gate over scan findings. AgentGuard implements attribute-based access control for tool calls. OPA and Cedar decide one authorisation at a time.

Use those to enforce. The gap AgentMandate fills is the one none of them cover: neither compound sequences nor a diff of effective authority across releases. The closest prior art in a neighbouring domain is IAM Access Analyzer, which derives reachable access from policy by automated reasoning rather than waiting for a log event. This is that idea pointed at agent tool graphs.

The lint command deliberately overlaps the scanners above. A tool that reported only compound findings would need one of them running alongside it to be usable at all.

Scope

What this does not do, on purpose:

  • No enforcement. No proxy, no runtime interception, no blocking.
  • No data-flow reachability. Finding that a read tool feeds an exfiltration path needs taint labels the manifest does not carry. Cumulative value and scope minting are what the current model supports honestly.
  • No model behaviour. Whether the agent would take a path is a different question from whether it may. This measures permission.
  • No inference of the fields that matter. mandate scan reads an MCP catalogue and writes the skeleton, but it cannot know whether an effect is reversible or what a ceiling is measured against. It guesses conservatively and marks every guess REVIEW. Extract then annotate, never extract and trust.

Search is bounded by limits.depth. No breach at depth 8 is not proof that none exists at depth 20, and the report says when it truncated.

Documentation

Development

python -m pip install -e ".[dev]"
python -m pytest -q
python -m pytest -q --cov=agentmandate --cov-fail-under=90
ruff check .

main is protected. Every change lands through a pull request with CI green.

Status

Alpha, version 0.1.0. The authority model is the part most likely to change, because it has not yet been pointed at enough real tool graphs to know where it is too coarse. Issues describing a graph it models badly are the most useful thing you can file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentmandate-0.1.0.tar.gz (43.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentmandate-0.1.0-py3-none-any.whl (29.8 kB view details)

Uploaded Python 3

File details

Details for the file agentmandate-0.1.0.tar.gz.

File metadata

  • Download URL: agentmandate-0.1.0.tar.gz
  • Upload date:
  • Size: 43.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for agentmandate-0.1.0.tar.gz
Algorithm Hash digest
SHA256 b12471854b91d5555d946f551eb546aa6e770b7bf70ae9e87c2f7b2ae689fc5d
MD5 6d671f5816a61801256d9241baf62a74
BLAKE2b-256 23254a9577bf3421f85dcf37aa2bcb5620271a8869d8e54db4726019c4390eeb

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentmandate-0.1.0.tar.gz:

Publisher: release.yml on mrwersa/agentmandate

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agentmandate-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: agentmandate-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 29.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for agentmandate-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 47656ff55602c502cf6e457840d0a8aa9d14bffdf028aa426b930e674fe0976a
MD5 4b3825e866b8d3add45267f5824ae8a2
BLAKE2b-256 c5c685759e3169ef54538338611375865bed665c8eaa26653825f6367e939370

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentmandate-0.1.0-py3-none-any.whl:

Publisher: release.yml on mrwersa/agentmandate

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page