Skip to main content

AI red teaming for SLMs and LLMs — independent adversarial validation

Project description

SichGate Pro

AI red teaming and compliance infrastructure for small language models deployed in regulated industries.

SichGate Pro runs adversarial tests against your AI models and generates EU AI Act Article 11 Technical Documentation automatically. It surfaces real vulnerabilities — bias, jailbreaks, prompt injection, hallucination, alignment failures — with findings mapped directly to regulatory requirements.

Every scan produces:

  • Validated adversarial findings with severity ratings
  • EU AI Act Annex IV section coverage
  • CycloneDX 1.6 AI Bill of Materials (AIBoM)
  • Cryptographic attestation (ed25519)
  • Differential red teaming report (base vs. fine-tuned model)
  • Article 11 Technical File PDF

Installation

pip install sichgate-pro

Requires Python 3.9+.


Quick start

# Activate your license
sichgate activate SG-XXXX-XXXX-XXXX-XXXX

# Run adversarial tests
sichgate run --model Qwen/Qwen2-1.5B-Instruct --output results.json

# Generate EU AI Act Technical File
sichgate technical-file --findings results.json --output technical_file.pdf

# System health check
sichgate check

# List all available attack modules
sichgate list-attacks

Commands

Command Description
sichgate activate Activate license key
sichgate deactivate Free this machine's license seat
sichgate run Execute adversarial test suite
sichgate technical-file Generate Article 11 Technical File PDF
sichgate diff Differential report: base vs. fine-tuned model
sichgate check System preflight and health check
sichgate list-attacks Show all available attack modules
sichgate estimate-cost Estimate scan cost before running

sichgate run

sichgate run --model MODEL [OPTIONS]
Option Default Description
--model, -m required HuggingFace model ID or local path
--attacks, -a all-llm Attack group or comma-separated names
--output, -o (print only) Write results to JSON file
--device auto Force device: cpu, cuda, mps
--adapter hf Model adapter: hf, openai_compat, callable
--aibom off Capture CycloneDX 1.6 AIBoM
--attest off Sign report with ed25519 attestation
--key-path (generate) Path to ed25519 private key PEM
--api-mode off Lightweight battery for API deployments
--provider gpt-4o API provider (with --api-mode)
--optimize off Auto-tune attacks with Optuna
--verbose, -v off Verbose logging

Attack groups

Group Attacks included
all-llm prompt-injection, jailbreak, token-smuggling, system-prompt-extraction, pii-leakage, training-data-extraction
all-evasion prompt-perturbation, simba, nes, hopskipjump, transfer
all everything above + model-extraction, backdoor-probe, membership-inference

Run sichgate list-attacks to see all available names.


Attack coverage

Attack Name flag
Prompt injection (direct) prompt-injection-direct
Prompt injection (indirect) prompt-injection-indirect
Jailbreak roleplay / persona jailbreak
Token smuggling / encoding bypass token-smuggling
System prompt extraction system-prompt-extraction
PII leakage probe pii-leakage
Training data extraction training-data-extraction
Adversarial text perturbation prompt-perturbation
SimBA word substitution simba
NES evolved variants nes
HopSkipJump boundary probe hopskipjump
Cross-model transfer attack transfer
Model architecture extraction model-extraction
Backdoor trigger probe backdoor-probe
Membership inference (score-based) membership-inference

Loading models

HuggingFace Hub

sichgate run --model Qwen/Qwen2-1.5B-Instruct
sichgate run --model meta-llama/Llama-3.2-1B-Instruct
sichgate run --model microsoft/Phi-3-mini-4k-instruct

Local HuggingFace format

Folder containing config.json + model.safetensors (or .bin):

sichgate run --model ./path/to/your-model
sichgate run --model ./medassist-tinyllama

Apple Silicon

On M-series Macs, pass --device cpu to avoid the MPS 4 GB NDArray limit during inference:

sichgate run --model Qwen/Qwen2-1.5B-Instruct --device cpu --output results.json

OpenAI-compatible API endpoint

sichgate run \
  --model gpt-4o \
  --adapter openai_compat \
  --api-mode \
  --provider gpt-4o \
  --output results.json

sichgate diff

Compare a base model against a fine-tuned variant. Runs the full attack battery on both and reports which vulnerabilities worsened, improved, or stayed the same.

sichgate diff \
  --base-model TinyLlama/TinyLlama-1.1B-Chat-v1.0 \
  --custom-model ./medassist-tinyllama \
  --output differential_report.json
Option Description
--base-model Base model path or HuggingFace ID
--custom-model Fine-tuned model path or HuggingFace ID
--attacks, -a Attack group (default: all-llm)
--output, -o Write differential report to JSON
--aibom / --no-aibom Embed AIBoM for both models (default: on)
--attest Sign report with ed25519
--key-path Path to ed25519 private key PEM
--adapter Model adapter: hf, openai_compat

sichgate technical-file

Generate an EU AI Act Article 11 Technical File from scan results.

sichgate technical-file \
  --findings results.json \
  --output technical_file.pdf

With all optional inputs:

sichgate technical-file \
  --findings results.json \
  --aibom aibom.json \
  --differential differential_report.json \
  --attest \
  --key-path signing_key.pem \
  --output technical_file.pdf

Produces three artefacts: technical_file.pdf, technical_file.html, technical_file.json.

If results.json was produced with --aibom, the AIBoM is loaded automatically — no separate --aibom flag needed.


sichgate estimate-cost

Show query counts and estimated API cost before running.

# API mode estimate
sichgate estimate-cost --mode api --provider gpt-4o

# Local mode estimate
sichgate estimate-cost --mode local

Full workflow example

# 1. Health check
sichgate check

# 2. Run full attack battery
sichgate run \
  --model Qwen/Qwen2-1.5B-Instruct \
  --attacks all \
  --device cpu \
  --aibom \
  --attest \
  --output results.json

# 3. Compare against fine-tuned variant
sichgate diff \
  --base-model Qwen/Qwen2-1.5B-Instruct \
  --custom-model ./my-finetuned-model \
  --device cpu \
  --output differential_report.json

# 4. Generate Technical File
sichgate technical-file \
  --findings results.json \
  --differential differential_report.json \
  --attest \
  --output technical_file.pdf

Compliance frameworks

Findings are automatically mapped to:

  • EU AI Act (Regulation (EU) 2024/1689) — Articles 9, 10, 13, 14, 15 + Annex IV
  • GDPR — Articles 5, 17, 22
  • HIPAA — §164.308, §164.312
  • NIST AI RMF — GOVERN, MAP, MEASURE, MANAGE
  • ISO/IEC 42001
  • OWASP LLM Top 10
  • CycloneDX 1.6 ML-BOM
  • NIST Cyber AI Profile (IR 8596)

License

Proprietary. License key required.

sichgate activate SG-XXXX-XXXX-XXXX-XXXX

Purchase at sichgate.com. Activates online once, then works fully offline. 7-day grace period for network outages.


Support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sichgate_pro-0.2.2.tar.gz (216.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sichgate_pro-0.2.2-py3-none-any.whl (219.1 kB view details)

Uploaded Python 3

File details

Details for the file sichgate_pro-0.2.2.tar.gz.

File metadata

  • Download URL: sichgate_pro-0.2.2.tar.gz
  • Upload date:
  • Size: 216.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for sichgate_pro-0.2.2.tar.gz
Algorithm Hash digest
SHA256 8a3d9efeb77e600c4ea3a70af8e1cc16a505f979333dd33a73bff942d9b7021d
MD5 e4a92c6a80b415f7c052a92ffb79244e
BLAKE2b-256 c38b6fdbfc85bff631dd331821f03e1153f022ed64a6d1db652caa2682fbc7ca

See more details on using hashes here.

File details

Details for the file sichgate_pro-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: sichgate_pro-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 219.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for sichgate_pro-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 aa06ad6e1d4e26c5c8c23c362ccfab8a6074a48035fe6d54a345eaf02527cc6c
MD5 0f9f0c554a3f2b8e6d4e2a138f5d88ca
BLAKE2b-256 2a07cbcc1be86c8c977a59da59c9105c55c7ef14f5dd96425e88a79a453cf46c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page