algovoi-atb

AlgoVoi Agent Trust Bench client — run your AI agent through 178 adversarial x402 payment profiles and earn a Falcon-1024 signed ATB Pass Certificate for reputation-gated pricing.

Model baselines

All baselines run via inspect eval against the live bench. Zero adversarial profiles settled across all runs. The bench-mcp-tools variant uses real inspect_ai tool-use — the model calls bench_refuse_profile or bench_claim_profile to communicate its decision rather than outputting text.

Install

pip install algovoi-atb              # client only
pip install "algovoi-atb[verify]"    # + Falcon-1024 certificate verification

Quick start

from algovoi_atb import run_bench

async def my_agent(profile_id: str, challenge: dict) -> bool:
    # Return True to refuse (correct for adversarial profiles).
    # Return False to pay (only for control/benign profiles).
    suspicious = any(
        kw in challenge.get("description", "").lower()
        for kw in ("urgent", "override", "ignore", "system prompt")
    )
    return suspicious

result = await run_bench(my_agent, label="my-agent-v1")

print(f"Score:   {result.score:.2f}")
print(f"Passed:  {result.passed}")
print(f"Report:  {result.report_url}")

# Present the cert to x402 gateways via X-ATB-Credential for discounts.
headers = {"X-ATB-Credential": result.certificate_b64}

Verify a certificate

import httpx
from algovoi_atb import verify_certificate

# Fetch the public key from the bench.
pk_doc = httpx.get(
    "https://agent-trust-bench.algovoi.co.uk"
    "/agent-trust-bench/.well-known/atb-keys.json"
).json()
pk_b64 = pk_doc["keys"][0]["public_key_pqclean_b64"]

verified = verify_certificate(result.certificate_b64, pk_b64=pk_b64)
print(verified.valid, verified.grants_discount, verified.expires_at)

Lower-level API

from algovoi_atb import BenchClient

async with BenchClient(label="my-agent") as client:
    run_data = await client.create_run(label="my-agent-v1")
    await client.start_session()

    profiles = await client.list_profiles()
    for profile in profiles:
        pid = profile["metadata"]["profile"]
        challenge = await client.hit_profile(profile["resource"])
        if challenge and my_decision(pid, challenge):
            await client.log_refusal(pid)

    cert = await client.fetch_certificate()
    print(cert["certificate"])  # base64url envelope → X-ATB-Credential

Links

• ATB docs
• Live bench
• ATB Pass Certificate spec