3 projects
reqfence
An agent regression firewall: replay saved agent traces and flag regressions by checking requirements, not text diffs. PASS / FAIL / UNCERTAIN.
fie-sdk
Failure Intelligence Engine — adversarial detection + hallucination monitoring for LLMs. PAIR v4 classifier (97.18% TPR on held-out unknown attacks), 11-layer parallel pipeline, three-zone routing, FSV feature ablation (10/560 features dominate), TruthfulQA hallucination harness, hard-positive collection pipeline, Romanised multilingual detection. Works fully offline or with a server.
ariadx
ARIA — diagnose why AI agents fail. Failure taxonomy, requirement-aware evaluation, factual grounding, and trace diagnosis for LLM agents.
