Skip to main content

AI red teaming for SLMs and LLMs — independent adversarial validation

Project description

SichGate Pro

AI red teaming and compliance infrastructure for small language models deployed in regulated industries.

SichGate Pro runs adversarial tests against your AI models and generates EU AI Act Article 11 Technical Documentation automatically. It surfaces real vulnerabilities — bias, jailbreaks, prompt injection, hallucination, alignment failures — with findings mapped directly to regulatory requirements.

Every scan produces:

  • Validated adversarial findings with severity ratings
  • EU AI Act Annex IV section coverage
  • CycloneDX 1.6 AI Bill of Materials (AIBoM)
  • Cryptographic attestation (ed25519)
  • Differential red teaming report (base vs. fine-tuned model)
  • Article 11 Technical File PDF

Installation

pip install sichgate-pro

Requires Python 3.9+.


Quick start

# Activate your license
sichgate activate SG-XXXX-XXXX-XXXX-XXXX

# Run adversarial tests
sichgate run --model Qwen/Qwen2-1.5B-Instruct --output results.json

# Generate EU AI Act Technical File
sichgate technical-file --findings results.json --output technical_file.pdf

# System health check
sichgate check

# List all available attack modules
sichgate list-attacks

Commands

Command Description
sichgate activate Activate license key
sichgate deactivate Free this machine's license seat
sichgate run Execute adversarial test suite
sichgate technical-file Generate Article 11 Technical File PDF
sichgate diff Differential report: base vs. fine-tuned model
sichgate check System preflight and health check
sichgate list-attacks Show all available attack modules
sichgate estimate-cost Estimate scan cost before running

sichgate run

sichgate run --model MODEL [OPTIONS]
Option Default Description
--model, -m required HuggingFace model ID or local path
--attacks, -a all-llm Attack group or comma-separated names
--output, -o (print only) Write results to JSON file
--device auto Force device: cpu, cuda, mps
--adapter hf Model adapter: hf, openai_compat, callable
--aibom off Capture CycloneDX 1.6 AIBoM
--attest off Sign report with ed25519 attestation
--key-path (generate) Path to ed25519 private key PEM
--api-mode off Lightweight battery for API deployments
--provider gpt-4o API provider (with --api-mode)
--optimize off Auto-tune attacks with Optuna
--verbose, -v off Verbose logging

Attack groups

Group Attacks included
all-llm prompt-injection, jailbreak, token-smuggling, system-prompt-extraction, pii-leakage, training-data-extraction
all-evasion prompt-perturbation, simba, nes, hopskipjump, transfer
all everything above + model-extraction, backdoor-probe, membership-inference

Run sichgate list-attacks to see all available names.


Attack coverage

Attack Name flag
Prompt injection (direct) prompt-injection-direct
Prompt injection (indirect) prompt-injection-indirect
Jailbreak roleplay / persona jailbreak
Token smuggling / encoding bypass token-smuggling
System prompt extraction system-prompt-extraction
PII leakage probe pii-leakage
Training data extraction training-data-extraction
Adversarial text perturbation prompt-perturbation
SimBA word substitution simba
NES evolved variants nes
HopSkipJump boundary probe hopskipjump
Cross-model transfer attack transfer
Model architecture extraction model-extraction
Backdoor trigger probe backdoor-probe
Membership inference (score-based) membership-inference

Loading models

HuggingFace Hub

sichgate run --model Qwen/Qwen2-1.5B-Instruct
sichgate run --model meta-llama/Llama-3.2-1B-Instruct
sichgate run --model microsoft/Phi-3-mini-4k-instruct

Local HuggingFace format

Folder containing config.json + model.safetensors (or .bin):

sichgate run --model ./path/to/your-model
sichgate run --model ./medassist-tinyllama

Apple Silicon

On M-series Macs, pass --device cpu to avoid the MPS 4 GB NDArray limit during inference:

sichgate run --model Qwen/Qwen2-1.5B-Instruct --device cpu --output results.json

OpenAI-compatible API endpoint

sichgate run \
  --model gpt-4o \
  --adapter openai_compat \
  --api-mode \
  --provider gpt-4o \
  --output results.json

sichgate diff

Compare a base model against a fine-tuned variant. Runs the full attack battery on both and reports which vulnerabilities worsened, improved, or stayed the same.

sichgate diff \
  --base-model TinyLlama/TinyLlama-1.1B-Chat-v1.0 \
  --custom-model ./medassist-tinyllama \
  --output differential_report.json
Option Description
--base-model Base model path or HuggingFace ID
--custom-model Fine-tuned model path or HuggingFace ID
--attacks, -a Attack group (default: all-llm)
--output, -o Write differential report to JSON
--aibom / --no-aibom Embed AIBoM for both models (default: on)
--attest Sign report with ed25519
--key-path Path to ed25519 private key PEM
--adapter Model adapter: hf, openai_compat

sichgate technical-file

Generate an EU AI Act Article 11 Technical File from scan results.

sichgate technical-file \
  --findings results.json \
  --output technical_file.pdf

With all optional inputs:

sichgate technical-file \
  --findings results.json \
  --aibom aibom.json \
  --differential differential_report.json \
  --attest \
  --key-path signing_key.pem \
  --output technical_file.pdf

Produces three artefacts: technical_file.pdf, technical_file.html, technical_file.json.

If results.json was produced with --aibom, the AIBoM is loaded automatically — no separate --aibom flag needed.


sichgate estimate-cost

Show query counts and estimated API cost before running.

# API mode estimate
sichgate estimate-cost --mode api --provider gpt-4o

# Local mode estimate
sichgate estimate-cost --mode local

Full workflow example

# 1. Health check
sichgate check

# 2. Run full attack battery
sichgate run \
  --model Qwen/Qwen2-1.5B-Instruct \
  --attacks all \
  --device cpu \
  --aibom \
  --attest \
  --output results.json

# 3. Compare against fine-tuned variant
sichgate diff \
  --base-model Qwen/Qwen2-1.5B-Instruct \
  --custom-model ./my-finetuned-model \
  --device cpu \
  --output differential_report.json

# 4. Generate Technical File
sichgate technical-file \
  --findings results.json \
  --differential differential_report.json \
  --attest \
  --output technical_file.pdf

Compliance frameworks

Findings are automatically mapped to:

  • EU AI Act (Regulation (EU) 2024/1689) — Articles 9, 10, 13, 14, 15 + Annex IV
  • GDPR — Articles 5, 17, 22
  • HIPAA — §164.308, §164.312
  • NIST AI RMF — GOVERN, MAP, MEASURE, MANAGE
  • ISO/IEC 42001
  • OWASP LLM Top 10
  • CycloneDX 1.6 ML-BOM
  • NIST Cyber AI Profile (IR 8596)

License

Proprietary. License key required.

sichgate activate SG-XXXX-XXXX-XXXX-XXXX

Purchase at sichgate.com. Activates online once, then works fully offline. 7-day grace period for network outages.


Support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sichgate_pro-0.2.1.tar.gz (216.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sichgate_pro-0.2.1-py3-none-any.whl (218.9 kB view details)

Uploaded Python 3

File details

Details for the file sichgate_pro-0.2.1.tar.gz.

File metadata

  • Download URL: sichgate_pro-0.2.1.tar.gz
  • Upload date:
  • Size: 216.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for sichgate_pro-0.2.1.tar.gz
Algorithm Hash digest
SHA256 b56b5aa61e14823ab3f51d6241732ec8059b0afc3843d653d5e67c8a4f602637
MD5 ce24508a13ca816e14d9d583d915e4d2
BLAKE2b-256 9e6c36b7f01f9fb01e301f93d8896722c1676763dd7c50d55dc98f3cf39d61fd

See more details on using hashes here.

File details

Details for the file sichgate_pro-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: sichgate_pro-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 218.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for sichgate_pro-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fe5ec1dec5ea0833c17a41379b295c92b079305816985c732afb31684fe530f9
MD5 bf2a2cefeb332ceaf59f86e95fa86b36
BLAKE2b-256 ef5f8da0ae0e79cb9009deb2bb907fe7d921e402736beaf3ab84183775938a7c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page