title: SimpleAudit Studio emoji: 🔍 colorFrom: blue colorTo: indigo sdk: docker app_port: 7860 pinned: false

SimpleAudit Studio

A self-hostable platform for running reproducible AI model audits using the SimpleAudit engine (Target → Auditor → Judge). Every audit captures frozen, versioned inputs so historical results stay interpretable years later.

🚀 Quick Start

uvx simpleaudit-studio

uvx installs the simpleaudit-studio package and runs it in an isolated environment. No Docker, no Postgres, no manual setup. Opens at http://localhost:8000 (login: admin / admin12345). A mock model server is pre-seeded so you can run an audit immediately.

🌐 Or skip the setup entirely — try the live demo: sushantgautam-simpleaudit-studio.hf.space

🤖 Using Real Models

The pre-seeded connections point at a built-in mock server. To run real audits, update your model connections on the Models page to any OpenAI-compatible endpoint. A few common options:

Set the API key in the connection form (leave blank for local servers that don't require auth), then launch an audit from the Scenario Library.

🐳 Self-Hosting

For teams, multi-user setups, or GPU worker pools, use Docker Compose:

git clone https://github.com/SushantGautam/SimpleAuditStudio
cd SimpleAuditStudio
cp .env.example .env
# edit POSTGRES_PASSWORD and BOOTSTRAP_ADMIN_PASSWORD at minimum
docker compose up -d

Services: Web UI (:8000), PostgreSQL, Hatchet queue (:8888), Worker. Optional profiles: --profile storage (MinIO), --profile mock (mock model API).

See docs/deployment.md for production hardening, GPU workers, backups, and upgrades.

✨ What You Can Do

• Browse the scenario library and create new audit scenarios
• Register model endpoints (OpenAI-compatible APIs)
• Launch audits and watch live progress
• Compare results across runs
• Explore the visualizer for detailed analysis

🏗️ Architecture

Browser → Django/Gunicorn (:7860)
              ↓
         PostgreSQL 16 (domain + queue DBs)
              ↓
         Hatchet Server (durable job queue)
              ↓
         Worker (CPU pool) → SimpleAudit Engine
              Target → Auditor → Judge

📚 Documentation

• Architecture — system design, service boundaries, deployment topology
• Domain Model — scenarios, scenario sets, audit runs, immutability invariants
• Deployment — Docker Compose, production hardening, GPU workers, upgrades

🤝 Contributing

Architecture decisions are documented in docs/architecture.md.