Skip to main content

AI red teaming for SLMs and LLMs — independent adversarial validation

Project description

SichGate Pro

Independent adversarial validation for SLMs and LLMs.

"We break AI systems to find what fails before attackers do."


Quick Start

# Install
pip install -e ".[dev]"

# Activate license (phones home once, then fully offline)
sichgate activate

# Run attacks
sichgate run --model ./path/to/model --attacks llm
sichgate run --model ./path/to/model --attacks all --output report.json
sichgate run --model ./path/to/model --attacks prompt-injection,membership-inference --optimize

# Launch dashboard (Phase 2)
sichgate start

Attack Categories

Category Attacks CLI Shorthand
LLM-Specific Prompt injection (direct + indirect), jailbreaks, token smuggling, training data extraction, system prompt extraction, PII/PHI leakage llm
Evasion Prompt perturbation, SimBA, NES, HopSkipJump, Transfer evasion
Extraction Model extraction (quick/standard/deep) extraction
Poisoning Backdoor probe (detection only) poisoning
Membership Inference Score-based (black-box) membership_inference
sichgate list-attacks  # full list

Architecture

Customer machine (100% local after activation)
├── sichgate CLI / React dashboard (localhost:3000)
├── FastAPI backend (localhost:8000)
├── Attack modules (Python)
├── SQLite (run history, results, schedules)
└── OS keychain (license token)

Your VPS ($5/mo)
└── License server (Flask + SQLite)
    ├── POST /activate
    ├── POST /deactivate
    └── POST /webhooks/stripe

Stripe
└── Billing → webhook → key generation → email

Nothing leaves the customer's machine except:

  • License key string (once, at activation)

JSON Output

Every attack result produces:

{
  "attack_type": "llm",
  "attack_name": "prompt_injection_direct",
  "model_target": "hf:./mymodel",
  "timestamp": "2025-03-01T10:00:00Z",
  "status": "fail",
  "severity": "critical",
  "input_payload": "...",
  "model_response": "...",
  "notes": "...",
  "compliance_tags": ["EU AI Act Annex III", "NIST AI RMF GV-1.1"],
  "execution_telemetry": {
    "status": "completed",
    "model_reachable": true,
    "attacks_attempted": 5,
    "attacks_completed": 5,
    "duration_ms": 1234
  }
}

Development

pip install -e ".[dev]"
pytest tests/ -v

License Server (VPS)

cd license_server
pip install -r requirements.txt
SICHGATE_JWT_SECRET=<your-secret> STRIPE_WEBHOOK_SECRET=<stripe-secret> python app.py

Tiers

  • Free: open-source CLI, GitHub (core LLM attacks)
  • Pro ($300/mo partners, $1k/mo open market): full attack suite + dashboard
  • Enterprise+ (2026): white-box attacks + gradient-based inference

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sichgate_pro-0.1.0.tar.gz (197.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sichgate_pro-0.1.0-py3-none-any.whl (191.1 kB view details)

Uploaded Python 3

File details

Details for the file sichgate_pro-0.1.0.tar.gz.

File metadata

  • Download URL: sichgate_pro-0.1.0.tar.gz
  • Upload date:
  • Size: 197.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for sichgate_pro-0.1.0.tar.gz
Algorithm Hash digest
SHA256 e8fdbc6c7f716aba3038634603e5cd1c05eb6641c813f39bfae88ccf68acf887
MD5 31afeaaf791f692487d9f2ba516bff22
BLAKE2b-256 11422dc491e30eee8d4ad2c8965fa028bda5ac52b65c46dd5ab001d00f7891ce

See more details on using hashes here.

File details

Details for the file sichgate_pro-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: sichgate_pro-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 191.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for sichgate_pro-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9e6228934987b8fd42863c38140be6d95a48c2c257bd3b32bbaf74f6b52e92c8
MD5 abf7ef92f45a2033cc1aaddf91ad6422
BLAKE2b-256 32b948c794f5e1ace9d4da40c39050cba6ed72d45bbd8f22d5562597d2b1484f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page