Skip to main content

Production readiness platform for AI agent pipelines — detects silent failures, captures full state, enables step-level replay.

Project description


Website PyPI version Python 3.9+ Beta

Catch silent failures in AI agent pipelines before production.

Your LangGraph pipeline runs fine — no exception. But three nodes later, something crashes with a KeyError. The real cause? A node upstream silently dropped a field. ARGUS catches this.


Install

pip install argus-agents

Quick Start

from argus import ArgusWatcher

watcher = ArgusWatcher(graph)       # attach to your StateGraph
app = graph.compile()
result = app.invoke(initial_state)  # run auto-saves on completion

That's it. ARGUS monitors every node, detects failures, and saves the run. No changes to your node functions.


What It Catches

Problem Example
Silent failures Node returns {} or drops a required field — no exception, pipeline keeps running broken
Semantic failures Output structure is fine but values are wrong (placeholders, refusals, degraded text)
Loop stalls Agent retries 5 times producing identical output — stuck loop burning tokens
Unnecessary retries Loop produces correct answer on attempt 2, but validator forces 3 more iterations
Crash root cause Traces KeyError at node 5 back to the upstream node that actually dropped the field
Contract violations Output types don't match the next node's expected input schema

Detection Layers

Runs in order, each more expensive — only fires when needed:

  1. Heuristics — 150+ failure signatures (placeholders, empty results, error keys, semantic degradation). Zero cost.
  2. Anomaly detector — statistical checks for output size anomalies, timing outliers. Deterministic.
  3. Correlator — traces failure propagation across nodes. Points at the origin, not the crash site.
  4. LLM investigator — root cause explanations and debugging suggestions. Only on ambiguous failures.
  5. Loop analyzer — mandatory LLM analysis for looped nodes: summarizes iterations, detects stalls, flags wasted retries.

Loop-Aware Inspection (new in v0.7.7)

Pipelines with loops (LLM → compiler → if fail, retry) get special treatment:

  • Earlier iterations that self-corrected are marked retried (not counted as failures)
  • Only the final iteration determines pass/fail
  • LLM automatically analyzes every loop: what went wrong, what changed between attempts, whether retries were necessary
  • Dashboard shows iteration badges, collapse/expand, and natural-language loop summaries

Replay

Fix a bug, re-run from the failing node. Skip upstream nodes entirely:

argus replay <run-id> node_7          # re-run from node_7 onward
argus replay <run-id> node_7 --only   # just that one node
argus diff <rerun-id>                 # compare vs original

External API calls (OpenAI, etc.) are recorded by default — replays are free and deterministic.


Semantic Judge

For subtle quality issues that pattern matching can't catch:

watcher = ArgusWatcher(graph, semantic_judge=True)

LLM evaluates output quality on every passing node. Catches wrong tone, unhelpful responses, outdated info.


Custom Validators

watcher = ArgusWatcher(graph, validators={
    "classify": lambda o: (o.get("label") in ["yes", "no"], "unexpected label"),
    "*":        lambda o: ("error" not in o, "error key present"),  # runs on every node
})

CLI

argus show last                      # most recent run
argus replay <id> <node>             # re-run from a node
argus diff <id-a> <id-b>             # compare two runs
argus ui                             # web dashboard
argus doctor                         # check setup health
argus login                          # sign in for cloud sync

Web Dashboard

argus ui    # opens at localhost:7842

Shows all runs, node-level detail, AI analysis, replay diffs, loop iteration badges, and comparison views. No account needed for local use.


Without LangGraph

from argus import ArgusSession

session = ArgusSession()
session.set_edges({"fetch": ["classify"], "classify": ["process"]})

fetch    = session.wrap("fetch",    fetch_fn)
classify = session.wrap("classify", classify_fn)
process  = session.wrap("process",  process_fn)

state = fetch(initial_state)
state = classify(state)
state = process(state)
session.finalize()

Works with any framework — Prefect, Temporal, plain Python.


Requirements

  • Python 3.9+
  • LangGraph 0.2+ (only for ArgusWatcher)
  • OPENAI_API_KEY in env for semantic features (optional — all heuristic detection works without it)

v0.7.7changelog

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

argus_agents-0.8.1.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

argus_agents-0.8.1-py3-none-any.whl (2.9 MB view details)

Uploaded Python 3

File details

Details for the file argus_agents-0.8.1.tar.gz.

File metadata

  • Download URL: argus_agents-0.8.1.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for argus_agents-0.8.1.tar.gz
Algorithm Hash digest
SHA256 b6e922088d63622af8509a611d2fe705c76843022f07f3efa8b8307d7e9bed9a
MD5 872883ac7a8210bb5cd794370ddc5653
BLAKE2b-256 a120952723d33928a0a01daa2124f2a78ab0eef5cb7a298a8676775a1892fe3b

See more details on using hashes here.

File details

Details for the file argus_agents-0.8.1-py3-none-any.whl.

File metadata

  • Download URL: argus_agents-0.8.1-py3-none-any.whl
  • Upload date:
  • Size: 2.9 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for argus_agents-0.8.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fd67131b3102c777305eeb9cbc118fc0554a12318b729f0166e6a515ddd8f4b5
MD5 91bf192bcd4a69ef42144c26e7710f87
BLAKE2b-256 ce844a38901198d7053ae239f66025ba7a9d512d0fc9bdf71f77493d48a6d47d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page