Skip to main content

Security testing for agentic AI

Project description

{q-AI}

pre-commit CI CodeQL Python 3.11+ License: Apache 2.0 Docs

Security testing for agentic AI

  • Audit MCP servers
  • Intercept agent traffic
  • Test tool poisoning and prompt injection
  • Execute multi-step attack chains
  • Generate IPI payloads
  • Poison coding assistant context files
  • Measure RAG retrieval rank

Local web UI orchestrates multi-module workflows.
All findings stored in a SQLite database.

Research program by Richard Spicer · {q-AI}


Quick Start

Scan an MCP server:

qai audit scan http://localhost:3000/sse

Transport is inferred automatically. Launch the web UI:

qai ui

Bring What You Have

Already running Garak or PyRIT? Import their results and let qai prove whether the weaknesses they found are exploitable in real agentic systems.

qai targets add "My Server" http://localhost:3000/sse
qai import report.jsonl --format garak --target <target-id>
qai import conversations.json --format pyrit --target <target-id>

Imported findings drive qai's native modules — inject payloads are prioritized based on compliance patterns your tools already discovered. Also supports SARIF from any tool.


Built-in Assistant

An AI assistant helps you discover capabilities, interpret scan results, and plan testing workflows. It uses RAG over qai's documentation and your own reference material, with a trust boundary model that separates trusted docs from untrusted scan output. Works with local models (Ollama) or cloud APIs.

qai config set assist.provider ollama
qai config set assist.model llama3.1
qai assist "how do I scan an MCP server?"

Framework Coverage

All audit findings map to four security taxonomies:

Framework Coverage
OWASP MCP Top 10 All 10 categories
OWASP Agentic Top 10 All 10 categories
MITRE ATLAS Technique-level mapping per finding category
CWE Weakness-level mapping per finding category

Install

pip install q-uestionable-ai

Or from source:

git clone https://github.com/q-uestionable-AI/qai.git
cd qai
uv sync --group dev

Full documentation at docs.q-uestionable.ai


Legal

All tools are intended for authorized security testing only. Only test systems you own, control, or have explicit permission to test. Responsible disclosure for all vulnerabilities discovered.

License

Apache 2.0

AI Disclosure

This project uses a human-led, AI-augmented workflow. See AI-STATEMENT.md

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

q_uestionable_ai-0.9.0.tar.gz (829.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

q_uestionable_ai-0.9.0-py3-none-any.whl (613.0 kB view details)

Uploaded Python 3

File details

Details for the file q_uestionable_ai-0.9.0.tar.gz.

File metadata

  • Download URL: q_uestionable_ai-0.9.0.tar.gz
  • Upload date:
  • Size: 829.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for q_uestionable_ai-0.9.0.tar.gz
Algorithm Hash digest
SHA256 b8ae998ad03f269dd49089ca02e13c1e6ad6b0d7a6e2f28e9236b138017dd7bb
MD5 671bdb2272a5f2957d0ac3c3a93f61ed
BLAKE2b-256 59fa2ea6d54612f5b6abbf3f9f99892d6c2b9c1057a7f2884631681021e11df8

See more details on using hashes here.

Provenance

The following attestation bundles were made for q_uestionable_ai-0.9.0.tar.gz:

Publisher: release.yml on q-uestionable-AI/qai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file q_uestionable_ai-0.9.0-py3-none-any.whl.

File metadata

File hashes

Hashes for q_uestionable_ai-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a5d8a35e9134f85fc40be5ec49009f514febd490dda55f2407a7df112c5b4f83
MD5 486a54bc7812f38cc0ea5a2ed96ab692
BLAKE2b-256 9b808e746fd92f0f042f9c4dc09befc3c1d1fe46e06e1e5f701edbac185f9914

See more details on using hashes here.

Provenance

The following attestation bundles were made for q_uestionable_ai-0.9.0-py3-none-any.whl:

Publisher: release.yml on q-uestionable-AI/qai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page