Skip to main content

Guard LLM tool calls with rules, scoring, and audit trails.

Project description

cascade

Guard LLM tool calls with rules, scoring, and audit trails.

PyPI version Python License: MIT Tests

cascade is a lightweight governance layer for AI agent tool calls. It sits between your LLM and tool execution — evaluate every tool call against rules, rank survivors by strategy, and audit every decision.

Quick Start

from cascade import DecisionPipeline

pipe = DecisionPipeline()
result = pipe.guard(
    tool_calls=[
        {"id": "1", "name": "search", "confidence": 0.92},
        {"id": "2", "name": "delete", "confidence": 0.15},
    ],
    rules=[
        {"field": "confidence", "op": "gte", "value": 0.5},
        {"field": "name", "op": "nin", "value": ["delete"]},
    ],
    strategy="softmax",
    top_k=1,
)

if result["selected"]:
    safe = result["selected"][0]
    print(f"Safe: {safe['name']} ({safe['confidence']})")

Installation

pip install cascade

Zero external dependencies. Optional extras extend the feature set:

pip install cascade[openai]     # OpenAI SDK adapter
pip install cascade[anthropic]  # Anthropic SDK adapter
pip install cascade[langchain]  # LangChain adapter
pip install cascade[crewai]     # CrewAI adapter
pip install cascade[yaml]       # YAML policy files + cascade policy lint

Adapters

Framework-specific adapters let you plug cascade governance into your existing agent code with minimal changes. Each adapter is a thin (<80 lines) layer — zero impact on the core codebase.

# OpenAI — auto-govern every chat.completions.create
from openai import OpenAI
from cascade import DecisionPipeline
from cascade.adapters.openai import wrap_openai_client

client = wrap_openai_client(
    OpenAI(),
    pipeline=DecisionPipeline(),
    rules=[{"field": "name", "op": "nin", "value": ["delete_file", "exec"]}],
)
# LangChain — post-process agent output
from cascade.adapters.langchain import guard_agent_output

result = agent.invoke({"input": "search for papers on AI safety"})
result = guard_agent_output(result, pipeline=pipe, rules=[...])

Why cascade?

  • Zero dependencies — pure Python, no pip wars
  • Plugs into any LLM framework — OpenAI, LangChain, or custom
  • Audit built in — every guard() auto-writes JSONL audit trails
  • 5 selection strategies — softmax / linear / uniform / threshold / ucb1
  • Self-emergence — C₃↔C₄ closed loop learns from outcomes
  • Composite rulesall_of / any_of / not_ for complex policies
  • Actionsblock / redirect / transform for automated remediation

Policies

Define governance rules in YAML for repeatable, audit-friendly policies.

# policy.yaml
name: strict-tools
description: Block dangerous tools
rules:
  - field: name
    op: nin
    value: [delete_file, exec, rm]
  - field: confidence
    op: gte
    value: 0.7
  - all_of:
      - field: name
        op: eq
        value: code_interpreter
      - field: confidence
        op: gte
        value: 0.9

strategy: softmax
top_k: 1
cascade policy lint policy.yaml
cascade check --tool-calls @tools.json --policy policy.yaml

Composite rules (all_of / any_of / not_), @import directives, and full schema validation are supported.

Audit chain integrity

Every guard() decision is recorded in a SHA-256 hash-chained JSONL audit trail. Each entry links to its predecessor via prev_hash, making the log tamper-evident.

cascade audit verify
from cascade._audit import AuditTrail

trail = AuditTrail()
result = trail.verify()  # {'valid': True, 'entries': 42, ...}

C1–C4 Architecture

C1 (Gate)      : Rule engine — 11 operators + AND/OR/NOT composition
C2 (Trigger)   : Event triggers — condition callbacks + state machine
C3 (Selector)  : Selection pressure — uniform/linear/softmax/threshold ranking
C4 (Feedback)  : Feedback loop — binary/proportional/threshold reward
Linkage        : C₃↔C₄ closed loop — rewards adjust future selection

Docs

File What it covers
docs/usage.md guard() API, DecisionPipeline, AuditTrail
docs/rules.md Leaf rules, rule presets, composite rules (all_of/any_of/not_)
docs/strategies.md Selection strategies and when to use each
docs/cli.md cascade check / policy lint / audit verify CLI reference
docs/owasp.md OWASP Agentic Top 10 compliance mapping
CHANGELOG.md Version history

Integrations

Framework Adapter Lines Install
OpenAI SDK wrap_openai_client() / guard_openai_response() ~70 cascade[openai]
Anthropic SDK guard_anthropic_response() / wrap_anthropic_client() ~70 cascade[anthropic]
LangChain guard_agent_output() ~55 cascade[langchain]
CrewAI guard_crew_output() / wrap_crew() ~65 cascade[crewai]
MCP Server guarded_tool() / MCPServerGuard ~100 zero-dep (core)

Each adapter is opt-in — the core stays zero-dependency. All adapters live in src/cascade/adapters/ and import only what they need at runtime.

For custom framework integrations, use pipe.guard() directly:

response = client.chat.completions.create(..., tools=my_tools)
result = pipe.guard(
    tool_calls=[{"id": t.id, "name": t.function.name, ...}],
    rules=[{"field": "name", "op": "nin", "value": BLOCKED_TOOLS}],
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agent_armour-0.6.0.tar.gz (42.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agent_armour-0.6.0-py3-none-any.whl (38.9 kB view details)

Uploaded Python 3

File details

Details for the file agent_armour-0.6.0.tar.gz.

File metadata

  • Download URL: agent_armour-0.6.0.tar.gz
  • Upload date:
  • Size: 42.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for agent_armour-0.6.0.tar.gz
Algorithm Hash digest
SHA256 8abbca79383230fe0756c538457fd9bedb21e86e9acdc5b08c11793c6ebdc3a0
MD5 7971271379fdde605c22f1f6c72d634b
BLAKE2b-256 b5857bff7ab2b550a75709a2fe4a1cf3a46534e3d88266c1ae8ed14b66b48e6c

See more details on using hashes here.

File details

Details for the file agent_armour-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: agent_armour-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 38.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for agent_armour-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2b405717c5486651f3372c238f00eab84055b4a2efcbe480411f30eb59b8380b
MD5 28a836e9e3aee5a15dedee93fa3fb62b
BLAKE2b-256 75758d07c2ca3647f28dc37e846e29af3609629b23866cad885fdafcd7a6421a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page