Skip to main content

Adaptive AI Agent Execution Layer for risk scoring, audit trails, and regulatory compliance

Project description

Vaara

PyPI Python License CI OpenSSF Scorecard OpenSSF Best Practices

Vaara intercepts agent tool calls, scores each one with a conformal risk interval, and writes a hash-chained audit record. Online learning across five expert signals via Multiplicative Weight Update. Distribution-free conformal coverage on the score.

For broader agent governance (zero-trust identity, capability-based access control, multi-language SDKs) see Microsoft's Agent Governance Toolkit.

Numbers

  • 5,955-entry adversarial corpus (3,422 attack across 8 categories, 2,533 benign)
  • 97.1% attack recall on held-out distribution-shift split, threshold 0.55
  • PAIR adaptive-attacker calibration: ASR 0/25 against Qwen2.5-32B
  • vaara-bench-v1: 77-trace synthetic-corpus benchmark with frozen methodology, 100% soft TPR, 0% hard FPR
  • 140 µs / 210 µs p99 inference latency, commodity CPU
  • Distribution-free conformal coverage on the score
  • MWU regret bound O(sqrt(T log N))

Install

pip install vaara

Python 3.10+. Zero runtime deps. Optional XGBoost classifier: pip install vaara[ml].

Quick start

from vaara.pipeline import InterceptionPipeline

pipeline = InterceptionPipeline()
result = pipeline.intercept(
    agent_id="agent-007",
    tool_name="fs.write_file",
    parameters={"path": "/etc/service.yaml", "content": "..."},
    agent_confidence=0.8,
)
if result.allowed:
    pipeline.report_outcome(result.action_id, outcome_severity=0.0)
else:
    print(result.reason)

report_outcome closes the loop. MWU reweights signals based on which ones predicted the outcome.

HTTP API

The same scorer and audit trail are available over HTTP for non-Python agents and for control planes that prefer a network boundary. Install with the server extra:

pip install 'vaara[server]'
vaara serve --host 0.0.0.0 --port 8000
curl -sX POST http://localhost:8000/v1/score \
  -H 'content-type: application/json' \
  -d '{"tool_name":"tx.transfer","agent_id":"agent-007","base_risk_score":0.5}'

The contract is in docs/openapi.yaml. Vaara defines the interface. Control-plane and orchestration vendors call it. Integration recipes for adopters live under examples/recipes/.

v0.13.0 adds three operator-facing endpoints. POST /v1/policy/reload atomically swaps the running policy without restarting the agent process (start with vaara serve --policy PATH to enable; in-flight requests keep the old thresholds, the next request sees the new ones). POST /v1/detect/injection and POST /v1/detect/pii expose Vaara's adversarial scorer and a zero-dependency PII extractor as named buyer-visible endpoints; the corresponding vaara detect injection and vaara detect pii CLI subcommands exit non-zero when the detector fires, so they slot into CI gates. vaara compliance dashboard --db PATH --out site/ renders a single-file static HTML article-coverage page from the same evidence model as vaara compliance report.

v0.14.0 adds an optional ML-DSA-65 (FIPS 204) signer for the regulator-handoff export envelope (pip install 'vaara[pq]'), suitable for retention horizons that cross the credible quantum threshold. The same release adds vaara.scorer.composition.ExternalScorer and vaara.scorer.composite.CompositeScorer so Vaara's adaptive scorer can be run alongside external scorers (NeMo Guardrails, another Vaara instance, any service that implements the /v1/score wire contract); the composite preserves the strongest decision across members.

v0.15.0 ships the first-party TypeScript client at clients/ts and on npm as @vaara/client. Typed wrappers over every v1 endpoint, Node 18+, ESM, declarations shipped. JS/TS agents (LangChain.js, Vercel AI SDK, MCP, any Node service) can now call Vaara without a Python sidecar.

npm install @vaara/client

v0.16.0 adds a PDF render to the article-evidence report. vaara compliance report --db PATH --format pdf --out report.pdf writes a styled single-file PDF (per-domain article tables plus per-article detail sections) suitable for attaching to a conformity submission or internal-audit binder. Requires pip install 'vaara[pdf]'. Markdown, JSON, and narrative renders remain unchanged.

v0.17.0 adds an OVERT 1.0 Base Envelope verifier CLI. vaara overt verify RECEIPT.cbor --pubkey-file PUB.bin validates any canonical-CBOR Base Envelope (Annex B.6) against a supplied raw 32-byte Ed25519 public key. The schema is closed per the OVERT 1.0 spec, so envelopes carrying unknown fields are rejected. The verifier reads only the wire format and takes no dependency on Vaara's emitter, so any OVERT-conformant implementation can route its conformance check through it. Requires the vaara[attestation] extra.

import { VaaraClient } from "@vaara/client";
const vaara = new VaaraClient({ baseUrl: "http://localhost:8000" });
const r = await vaara.score({ tool_name: "tx.transfer", agent_id: "agent-007", base_risk_score: 0.6 });
if (r.decision === "deny") throw new Error("blocked");

OVERT 1.0 attestation

Vaara implements the OVERT 1.0 (overt.is) Protocol Profile 1.0 Base Envelope. OVERT 1.0 is an open standard for runtime trust in AI systems, authored by Glacis Technologies and published 25 March 2026. Closed-schema 9-field structure at AAL-3 Phase 2 (Provisional Receipt), canonical CBOR (RFC 8949), Ed25519 signatures, HMAC-SHA256 keyed commitments, IEEE-754 float rejection. v0.13.0 adds a reference Phase 3 IAP (vaara.attestation.iap) that notary-signs the Provisional Receipt and anchors it in a transparency log; production deployments can swap in sigstore Rekor or an equivalent independently-operated log at the same call sites.

pip install 'vaara[attestation]'
from vaara.attestation.overt import emit_base_envelope, make_request_commitment, encoder_binary_identity

envelope = emit_base_envelope(
    signing_key=key,
    request_commitment=make_request_commitment(payload, operator_key=op_key),
    encoder_binary_identity=encoder_binary_identity(arbiter_version="vaara/0.15.0", policy_hash=ph),
    non_content_metadata={"action_class": "tx.transfer", "decision": "escalate"},
    monotonic_counter=42,
    arbiter_instance_identifier=uuid_bytes,
)

Vaara operates as the Arbiter in OVERT terms. See COMPLIANCE.md "Position relative to open runtime-attestation standards" for the architectural framing.

v0.12.0 adds an OVERT S3P (MEA-2) emitter with exact Clopper-Pearson confidence intervals (pure Python, no scipy), plus a proposed Protocol Profile extension that reports aggregate statistics over Vaara's per-action conformal prediction intervals alongside the standard binomial CI. The agentic-controls mapping in COMPLIANCE.md "OVERT 1.0 Part 3 (Agentic AI Controls) mapping" walks Vaara's coverage of TOOL-, MCP-, MULTI-, CAP-, DISC-, HITL-, and DRIFT-* control by control.

from vaara.attestation.s3p import emit_s3p_attestation, ConformalExtension, make_epoch_nonce_commitment

Where things live

  • docs/formal_specification.md: math. MWU regret bound O(sqrt(T log N)), conformal coverage guarantees, security properties.
  • COMPLIANCE.md: Article-level evidence mapping for EU AI Act (Articles 9, 11 to 15, 61) and DORA (Articles 10, 12, 13). Eval numbers, threshold sweeps, PAIR adversarial calibration.
  • Article 14 runtime: why oversight of agentic AI has to be evidenced as action, not model: why this exists. Posted on the EU Apply AI Alliance Futurium.
  • src/vaara/integrations/: LangChain, OpenAI Agents SDK, CrewAI, MCP server.
  • src/vaara/audit/: hash-chain trail, SQLite backend, append-only WAL.
  • src/vaara/policy/: declarative YAML / JSON policy schema with vaara policy validate (semantic checks) and vaara policy test (Conftest-style cases-file runner) for reviewing the policy artifact in CI independently from agent code.
  • src/vaara/sandbox/: synthetic-trace cold-start calibration.

Vaara helps deployers assemble evidence for their own conformity work. It does not certify compliance or constitute legal advice. Deployers own their obligations under the EU AI Act and other applicable law.

License

LICENSE

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vaara-0.17.0.tar.gz (453.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vaara-0.17.0-py3-none-any.whl (408.7 kB view details)

Uploaded Python 3

File details

Details for the file vaara-0.17.0.tar.gz.

File metadata

  • Download URL: vaara-0.17.0.tar.gz
  • Upload date:
  • Size: 453.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for vaara-0.17.0.tar.gz
Algorithm Hash digest
SHA256 24c918e8e955321fc48bbacb4fdbfee718a75e0a8ac1fd0b1e591b58735b2376
MD5 618427c62c738c6e56d68d21ef0f4db9
BLAKE2b-256 4e9e7ce7c310ab74f48bed6c67450724a5230f8d2c71a9152656aefaa7277817

See more details on using hashes here.

Provenance

The following attestation bundles were made for vaara-0.17.0.tar.gz:

Publisher: release.yml on vaaraio/vaara

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file vaara-0.17.0-py3-none-any.whl.

File metadata

  • Download URL: vaara-0.17.0-py3-none-any.whl
  • Upload date:
  • Size: 408.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for vaara-0.17.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c739ab0d6fd6b5cf27a3fe685a23e56348ac4c05512c4c2a92649c576b8236c6
MD5 dd4d418c45330028c280a3452b2b3546
BLAKE2b-256 46562f590689894e1577991709cc6df9749bd2e4ba618591c403952bb9e81a1b

See more details on using hashes here.

Provenance

The following attestation bundles were made for vaara-0.17.0-py3-none-any.whl:

Publisher: release.yml on vaaraio/vaara

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page