Skip to main content

Adaptive AI Agent Execution Layer for risk scoring, audit trails, and regulatory compliance

Project description

Vaara

PyPI Python License CI OpenSSF Scorecard OpenSSF Best Practices

Vaara intercepts agent tool calls, scores each one with a conformal risk interval, and writes a hash-chained audit record. Online learning across five expert signals via Multiplicative Weight Update. Distribution-free conformal coverage on the score.

For broader agent governance (zero-trust identity, capability-based access control, multi-language SDKs) see Microsoft's Agent Governance Toolkit.

Numbers

  • 5,955-entry adversarial corpus (3,422 attack across 8 categories, 2,533 benign)
  • 97.1% attack recall on held-out distribution-shift split, threshold 0.55
  • PAIR adaptive-attacker calibration: ASR 0/25 against Qwen2.5-32B
  • 140 µs / 210 µs p99 inference latency, commodity CPU
  • Distribution-free conformal coverage on the score
  • MWU regret bound O(sqrt(T log N))

Install

pip install vaara

Python 3.10+. Zero runtime deps. Optional XGBoost classifier: pip install vaara[ml].

Quick start

from vaara.pipeline import InterceptionPipeline

pipeline = InterceptionPipeline()
result = pipeline.intercept(
    agent_id="agent-007",
    tool_name="fs.write_file",
    parameters={"path": "/etc/service.yaml", "content": "..."},
    agent_confidence=0.8,
)
if result.allowed:
    pipeline.report_outcome(result.action_id, outcome_severity=0.0)
else:
    print(result.reason)

report_outcome closes the loop. MWU reweights signals based on which ones predicted the outcome.

Where things live

  • docs/formal_specification.md: math. MWU regret bound O(sqrt(T log N)), conformal coverage guarantees, security properties.
  • COMPLIANCE.md: Article-level evidence mapping for EU AI Act (Articles 9, 11 to 15, 61) and DORA (Articles 10, 12, 13). Eval numbers, threshold sweeps, PAIR adversarial calibration.
  • Article 14 runtime: why oversight of agentic AI has to be evidenced as action, not model: why this exists. Posted on the EU Apply AI Alliance Futurium.
  • src/vaara/integrations/: LangChain, OpenAI Agents SDK, CrewAI, MCP server.
  • src/vaara/audit/: hash-chain trail, SQLite backend, append-only WAL.
  • src/vaara/policy/: declarative YAML / JSON policy schema with vaara policy validate (semantic checks) and vaara policy test (Conftest-style cases-file runner) for reviewing the policy artifact in CI independently from agent code.
  • src/vaara/sandbox/: synthetic-trace cold-start calibration.

Vaara helps deployers assemble evidence for their own conformity work. It does not certify compliance or constitute legal advice. Deployers own their obligations under the EU AI Act and other applicable law.

License

LICENSE

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vaara-0.9.0.tar.gz (404.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vaara-0.9.0-py3-none-any.whl (356.1 kB view details)

Uploaded Python 3

File details

Details for the file vaara-0.9.0.tar.gz.

File metadata

  • Download URL: vaara-0.9.0.tar.gz
  • Upload date:
  • Size: 404.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for vaara-0.9.0.tar.gz
Algorithm Hash digest
SHA256 730a0c025a56e26fae0407efcfe8896409295880cf5d2d7b4ec347c4d6d22dcd
MD5 20324450b69c6c1bc9e8e0b3b5904b4e
BLAKE2b-256 8e2eb6ad7feff0ab3730cf1cd3ec0a31369eacb26ffaad8d0df763f828fb26fd

See more details on using hashes here.

File details

Details for the file vaara-0.9.0-py3-none-any.whl.

File metadata

  • Download URL: vaara-0.9.0-py3-none-any.whl
  • Upload date:
  • Size: 356.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for vaara-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 34b9d0ddf19f121f953a80c339fd041d7d72262fb5cf4339828b4222068d1d33
MD5 fb1229e037140fd839da5a54c50f5754
BLAKE2b-256 684b439b16ebeae5014dacc9ee95653f48838122b4c3ec7cfe8480d7774bb6da

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page