Skip to main content

XORCISE.AI — Trust Evidence, not Claims.

PyPI Python 3.12+ Tested on Ubuntu CI License Apache-2.0

Quickstart · Output · Agents · Missions · Open source · Website · Docs · Contributing · Security


Run your cyber-AI agent against a real mission. Watch everything it does. Grade the evidence.

AI can take action. It cannot bear consequences.

A benchmark score tells you an agent finished. It says nothing about the destructive commands it tried on the way there. XORCISE runs the agent against a live target inside a contained environment, records every command, tool call and dead end as OpenTelemetry evidence, and grades that evidence against the mission's own criteria.

Trust is not declared. It is demonstrated.

Quickstart

Tested on Ubuntu. Needs Python 3.12+ and Docker Engine.

pip install xorcise
xorcise doctor                            # checks the host first
xorcise up                                # boots the stack, prints the console URL
xorcise config set-model --name <model> --key-stdin          # the judge — half the score
xorcise agent register --name my-agent --kind claude-code
xorcise mission list
xorcise mission pull aviary-access
xorcise run create --agent my-agent --mission aviary-access
xorcise run launch-cmd <run_id>           # paste into your agent's terminal, then run it
xorcise run status <run_id>               # score, breakdown, evidence

--key-stdin prompts for the judge key without echoing it, and reads a pipe when there is one (printf %s "$KEY" | xorcise config set-model --key-stdin), so the credential never reaches your shell history or /proc/<pid>/cmdline.

xorcise down stops it all. No Docker on the box? xorcise up --stub is the self-contained demo. xorcise --help has the rest, and docs.xorcise.ai walks through a first run end to end.

Prefer to work from source? See Contributing → Setup.

What comes out

Live trace every command, tool call and message, streaming into the console as it happens
Score deterministic checks plus a bring-your-own-model judge
Report the full run record, exportable — Markdown, HTML, JSONL
Leaderboard agents ranked across recorded results

Every run gets its own private network and a fresh environment, created for the run and destroyed after it. An agent under evaluation cannot reach the host, or another run.

Bring your agent

XORCISE evaluates the agent you already use.

OpenHands full trace + tool-call capture
Claude Code via OTLP telemetry
Codex CLI via OTLP telemetry
Anything custom register it, drive it with the connect prompt, submit over REST

Activity is normalised into one event model, so the trace, the grading and the report read the same whichever harness produced the run.

Missions

A mission is a self-contained target: services, a network, and the criteria an agent is graded against. Packaged as bundles, pulled on demand.

Missions are deliberately vulnerable — SQL injection, IDOR, network pivots. That is the point: they exist so an agent has something real to find.

Run XORCISE on infrastructure you are willing to lose — a dedicated VM or an isolated cloud environment, never a workstation holding credentials you care about. It executes untrusted agent code against vulnerable targets by design.

Only point XORCISE at systems you own, or that you have specific written authorisation to test. See Acceptable use.

Open source

XORCISE goes public in parts, not whole. This repository is the engine — the CLI, harness adapters, isolation, grading and console — under Apache-2.0, with issues and pull requests open.

The evaluation technology is open source. The commercial layer — managed deployment, runtime, command and sovereign hosting — is not. The agent skills and the documentation source are published separately as they are readied.

Documentation & help

xorcise.ai the project website — what XORCISE is and who it is for
Documentation first run, missions, grading, traces, the full CLI and API reference
Contributing dev setup, the test lanes, the PR process, versioning
Security what's in scope, and how to report privately
Acceptable use what to point XORCISE at, export control, sanctions
Maintainers · Code of Conduct who to ask, and how we work

Found a vulnerability? Do not open a public issue — report it privately. Flaws in the harness, the isolation boundary or the supply chain are in scope; flaws inside a mission are the content.

License

Apache-2.0 © 2026 Fifth Domain Pty Ltd (ACN 606 251 585)

XORCISE.AI is a business name of Fifth Domain Pty Ltd. Contributions are accepted under the Contributor License Agreement. "XORCISE" and "XORCISE.AI", the associated logos and wordmarks, and the xorcise.ai domain are trademarks — see the trademark policy and NOTICE.


XORCISE.AI — Trust Evidence, not Claims.

Metadata

Release files for xorcise 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for xorcise 0.2.1
File Size Uploaded Provenance Actions
xorcise-0.2.1.tar.gz 2.2 MB With provenance Details for xorcise-0.2.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for xorcise 0.2.1
File Interpreter ABI Platform Actions
xorcise-0.2.1-py3-none-any.whl Python 3 none any Details for xorcise-0.2.1-py3-none-any.whl

Total release size: 3.6 MB

Release files / xorcise-0.2.1.tar.gz

Download URL xorcise-0.2.1.tar.gz
Size 2.2 MB
Tags Source
SHA-256 checksum
How to use checksums
017cd5cf6d453abc62fa3417e2c8e5e98935274fd8947809230ece9b1129d15b
BLAKE2b-256 checksum
How to use checksums
1f64153216972d58eebadf3ae0ee12c39f0bb72cbf38ffdca76008be45f35999
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 29, 2026.

Transparency log

Release files / xorcise-0.2.1-py3-none-any.whl

Download URL xorcise-0.2.1-py3-none-any.whl
Size 1.4 MB
Tags Python 3
SHA-256 checksum
How to use checksums
50d2a9fae9936b62aba7862bc2d17573d9bb1b9978ed4623991d04d63de9876b
BLAKE2b-256 checksum
How to use checksums
902591a8b873bdf7036e41d452bdb772df4931cf096e23ec5c744410e2fb7fc6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 29, 2026.

Transparency log

Security for xorcise 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for xorcise-0.2.1.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 29, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page