Skip to main content

Adversarial security testing CLI for AI models

Project description

RednBlue CLI v2.4.0

Zero-Knowledge Adversarial Security Testing for AI Models

RednBlue CLI is a command-line tool for testing the adversarial robustness of machine learning models. Run security assessments locally — your model never leaves your infrastructure.

███████████               ███████████
▒▒███▒▒▒▒▒███             ▒▒███▒▒▒▒▒███
 ▒███    ▒███  ████████    ▒███    ▒███
 ▒██████████  ▒▒███ ▒▒███  ▒██████████
 ▒███▒▒▒▒▒███  ▒███  ▒███  ▒███▒▒▒▒▒███
 ▒███    ▒███  ▒███  ▒███  ▒███    ▒███
 █████   █████ ████  █████ ███████████
▒▒▒▒▒   ▒▒▒▒▒ ▒▒▒▒  ▒▒▒▒▒ ▒▒▒▒▒▒▒▒▒▒▒

Zero-Knowledge Adversarial Security Testing

Features

  • Zero-Knowledge Protocol — Model weights and data never leave your infrastructure
  • Image Classifiers — Test ResNet, VGG, EfficientNet, and custom architectures
  • YOLO Detection — Full support for YOLOv5, YOLOv8, YOLOv10, YOLOv11
  • Tier-Based Testing — Freelancer (quick scan) and Enterprise (comprehensive)
  • Encrypted Submission — AES-256 encrypted results with HMAC-SHA256 signing
  • Multi-Jurisdiction Compliance — EU AI Act, NIST AI RMF, ISO/IEC 42001, UK DSIT, Canada AIDA, Singapore MAIGF

Installation

# Clone the repository
git clone https://github.com/mahdidrm/RednBlue_CLI.git
cd RednBlue_CLI

# Install in development mode
pip install -e .

# Verify installation
rnb

Requirements

  • Python 3.8+
  • PyTorch 2.0+
  • CUDA (optional, for GPU acceleration)

Quick Start

1. Set your token

# Windows
set RNB_TOKEN=RB-XXXXXX-YYYYYY

# Linux/Mac
export RNB_TOKEN=RB-XXXXXX-YYYYYY

2. Run a security assessment

Image Classifier:

rnb preview --model resnet50.pth --input ./test_images --model-type classifier

YOLO Detection Model:

rnb preview --model yolov10n.pt --input ./test_images --model-type yolo

3. Submit for certification

rnb preview --model yolov10n.pt --input ./images --model-type yolo --submit

Commands

Command Description
rnb Show welcome banner and quick start
rnb preview --help Run adversarial attacks
rnb status Check token validity and tier
rnb optimize-epsilon Optimize epsilon values (Enterprise)
rnb test-llm Test LLM models (Enterprise)

Assessment Dimensions

Classifier Models

Dimension Description
Noise Resilience Stability under sensor noise and interference
Spatial Consistency Robustness to spatial feature shifts
Universal Pattern Defense Resistance to universal perturbation patterns
Feature Stability Internal representation integrity
Confidence Calibration Prediction reliability accuracy
Iterative Stress Tolerance Defense against sustained pressure
Optimization Attack Defense Resistance to optimized adversarial inputs
Deep Perturbation Resistance Resilience against deep layer perturbations

YOLO Detection Models

Dimension Description
Noise Resilience Stability under sensor noise
Input Perturbation Defense Resistance to subtle input modifications
Iterative Stress Tolerance Defense against multi-step attacks
Detection Consistency Reliable detection under varying conditions
Targeted Evasion Defense Resistance to deliberate misclassification
Object Persistence Maintains detections under perturbations
Multi-Object Stability Accuracy in crowded scenes
Black-Box Resilience Defense without model access
Query-Limited Defense Resistance to low-query probing

Tier Comparison

Feature Freelancer Enterprise
Classifier Attacks 5 8
YOLO Attacks 4 9
Epsilon Values 2 4
Total Scenarios ~10-20 ~30-70
LLM Testing
Epsilon Optimization

Output Example

============================================================
  RednBlue Security Preview — YOLO Detection
============================================================
  Attacks run    : 21
  Successful hits: 0/21 (0%)
  Robustness rate: 100%
  Estimated Grade: GOLD

  ⚠️  This is a preview only
  → Visit: https://rednblue.io/checkout
  → Re-run with: rnb preview --model-type yolo --submit

Certification Grades

Grade Score Meaning
🥇 GOLD ≥90% Excellent robustness, deployment ready
🥈 SILVER ≥75% Good robustness, minor improvements recommended
🥉 BRONZE ≥50% Moderate robustness, improvements needed

Architecture

┌─────────────────────────────────────────────────────────┐
│                    Your Infrastructure                   │
│  ┌─────────┐    ┌─────────┐    ┌─────────────────────┐  │
│  │  Model  │───▶│   CLI   │───▶│  Encrypted Results  │  │
│  └─────────┘    └─────────┘    └──────────┬──────────┘  │
└───────────────────────────────────────────┼─────────────┘
                                            │ AES-256
                                            ▼
                              ┌─────────────────────────┐
                              │   RednBlue Platform     │
                              │  dashboard.rednblue.io  │
                              └─────────────────────────┘

Links


Authors

  • Dr. Mahdi Deramgozin — Chief AI Officer
  • Dr. Saeid Samizade — Chief Technology Officer

License

Proprietary — RednBlue SAS © 2026

Made in France 🇫🇷

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rednblue-2.4.0.tar.gz (31.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rednblue-2.4.0-py3-none-any.whl (34.4 kB view details)

Uploaded Python 3

File details

Details for the file rednblue-2.4.0.tar.gz.

File metadata

  • Download URL: rednblue-2.4.0.tar.gz
  • Upload date:
  • Size: 31.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for rednblue-2.4.0.tar.gz
Algorithm Hash digest
SHA256 8ddd2424a86d4cee14e136ea33c26dacd6f19d7fdff4dbc226af6aaeaf68c9fa
MD5 a2402eeed7a99e5ee5f19e00bd3c877f
BLAKE2b-256 d09cf5da7074f2653cb3d8c370aa94c3775a4947306c7bb269589399b79a12de

See more details on using hashes here.

File details

Details for the file rednblue-2.4.0-py3-none-any.whl.

File metadata

  • Download URL: rednblue-2.4.0-py3-none-any.whl
  • Upload date:
  • Size: 34.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for rednblue-2.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8f4be6d0d9ee1139cd80ab19659dd8cefe18f84231f8a784ff5e59628ee3b632
MD5 20e2194894bbbc2865fabaf7b6eaa3a7
BLAKE2b-256 2f42c0e40358b287087ddc9a71e16394c751da3aac810287e240dd1a146a71cd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page