AI red teaming for SLMs and LLMs — independent adversarial validation
Project description
SichGate Pro
Independent adversarial validation for SLMs and LLMs.
"We break AI systems to find what fails before attackers do."
Quick Start
# Install
pip install -e ".[dev]"
# Activate license (phones home once, then fully offline)
sichgate activate
# Run attacks
sichgate run --model ./path/to/model --attacks llm
sichgate run --model ./path/to/model --attacks all --output report.json
sichgate run --model ./path/to/model --attacks prompt-injection,membership-inference --optimize
# Launch dashboard (Phase 2)
sichgate start
Attack Categories
| Category | Attacks | CLI Shorthand |
|---|---|---|
| LLM-Specific | Prompt injection (direct + indirect), jailbreaks, token smuggling, training data extraction, system prompt extraction, PII/PHI leakage | llm |
| Evasion | Prompt perturbation, SimBA, NES, HopSkipJump, Transfer | evasion |
| Extraction | Model extraction (quick/standard/deep) | extraction |
| Poisoning | Backdoor probe (detection only) | poisoning |
| Membership Inference | Score-based (black-box) | membership_inference |
sichgate list-attacks # full list
Architecture
Customer machine (100% local after activation)
├── sichgate CLI / React dashboard (localhost:3000)
├── FastAPI backend (localhost:8000)
├── Attack modules (Python)
├── SQLite (run history, results, schedules)
└── OS keychain (license token)
Your VPS ($5/mo)
└── License server (Flask + SQLite)
├── POST /activate
├── POST /deactivate
└── POST /webhooks/stripe
Stripe
└── Billing → webhook → key generation → email
Nothing leaves the customer's machine except:
- License key string (once, at activation)
JSON Output
Every attack result produces:
{
"attack_type": "llm",
"attack_name": "prompt_injection_direct",
"model_target": "hf:./mymodel",
"timestamp": "2025-03-01T10:00:00Z",
"status": "fail",
"severity": "critical",
"input_payload": "...",
"model_response": "...",
"notes": "...",
"compliance_tags": ["EU AI Act Annex III", "NIST AI RMF GV-1.1"],
"execution_telemetry": {
"status": "completed",
"model_reachable": true,
"attacks_attempted": 5,
"attacks_completed": 5,
"duration_ms": 1234
}
}
Development
pip install -e ".[dev]"
pytest tests/ -v
License Server (VPS)
cd license_server
pip install -r requirements.txt
SICHGATE_JWT_SECRET=<your-secret> STRIPE_WEBHOOK_SECRET=<stripe-secret> python app.py
Tiers
- Free: open-source CLI, GitHub (core LLM attacks)
- Pro ($300/mo partners, $1k/mo open market): full attack suite + dashboard
- Enterprise+ (2026): white-box attacks + gradient-based inference
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sichgate_pro-0.1.0.tar.gz
(197.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
sichgate_pro-0.1.0-py3-none-any.whl
(191.1 kB
view details)
File details
Details for the file sichgate_pro-0.1.0.tar.gz.
File metadata
- Download URL: sichgate_pro-0.1.0.tar.gz
- Upload date:
- Size: 197.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e8fdbc6c7f716aba3038634603e5cd1c05eb6641c813f39bfae88ccf68acf887
|
|
| MD5 |
31afeaaf791f692487d9f2ba516bff22
|
|
| BLAKE2b-256 |
11422dc491e30eee8d4ad2c8965fa028bda5ac52b65c46dd5ab001d00f7891ce
|
File details
Details for the file sichgate_pro-0.1.0-py3-none-any.whl.
File metadata
- Download URL: sichgate_pro-0.1.0-py3-none-any.whl
- Upload date:
- Size: 191.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9e6228934987b8fd42863c38140be6d95a48c2c257bd3b32bbaf74f6b52e92c8
|
|
| MD5 |
abf7ef92f45a2033cc1aaddf91ad6422
|
|
| BLAKE2b-256 |
32b948c794f5e1ace9d4da40c39050cba6ed72d45bbd8f22d5562597d2b1484f
|