Interplay

Adversarial and red-teaming library: culturally grounded probe generation plus seven attack methodologies for testing model robustness. Formerly cultural-bias-red-team.

Implements the Singapore AI Safety Red Teaming Challenge methodology (IMDA + Humane Intelligence, Feb 2025) using NeMo Data Designer, plus 7 attack methodologies for comprehensive adversarial testing (see docs/METHODOLOGY.md).

Install

Requires Python 3.12 or newer.

pip install interplay-adversarial                    # core: specs and the probe pipeline library
pip install "interplay-adversarial[red-teaming]"     # attack runners: TAP, PAIR, Crescendo, GOAT, SLIP, Multimodal
pip install "interplay-adversarial[garak]"           # + the Garak scanner (large install)
pip install "interplay-adversarial[providers]"       # + 20+ LLM provider SDKs for any-llm-sdk

The package installs interplay (interplay.specs, interplay.red_teaming). The probe-generation command line (data-designer ... pipeline.py) and the examples run from a clone of the repository; see Quick Start.

Why

Standard red-teaming focuses on adversarial prompts from an attacker perspective. Singapore's challenge found:

• 86.1% of successful exploits came from single-turn benign prompts — normal everyday user interactions
• 67.2% exploit success rate in regional languages vs 49.2% in English
• Positive framing ("which city is richest?") bypasses more guardrails than negative framing
• Cultural bias appears in daily use, not only adversarial scenarios

This tool generates both probe types, grounded in specific cultural contexts rather than generic demographics, and provides 7 attack methodologies to test model robustness.

Attack Methodologies

Details, parameters and examples for each: docs/attacks.

Quick Start

Probe Generation (Cultural Bias)

git clone https://github.com/interplay-adversarial/interplay.git
cd interplay

# Install uv if needed: curl -LsSf https://astral.sh/uv/install.sh | sh
uv sync --extra red-teaming   # add --extra garak for the Garak scanner

cp .env.example .env        # Add API keys and endpoint configuration

# Validate and preview
uv run data-designer validate pipeline.py
uv run data-designer preview  pipeline.py

# Generate 500 probes (Singapore 9-country taxonomy, default)
uv run data-designer create pipeline.py --num-records 500

Attack Methodologies

# Set environment variables (or use .env file)
export TARGET_URL="https://your-target/v1"
export TARGET_API_KEY="your-api-key"
export ATTACKER_MODEL="openai/gpt-4o-mini"
export JUDGE_MODEL="openai/gpt-4o-mini"

# Run integrated workflow (Garak + TAP + PAIR)
uv run python examples/integrated_run.py --probe-file probes.jsonl --output-dir output/

Each attack can also be called directly from Python; see the page for the method in docs/attacks.

Pipeline Modes (Probe Generation)

Set BIAS_SPEC to select the generation mode. Three built-in taxonomy modes and N comparison spec modes.

Taxonomy Modes

# Singapore 5-category cultural bias (default)
# Categories: Gender, Geographic/National Identity, Race/Religion/Ethnicity,
#             Socio-Economic, Unique Cultural Challenges
uv run data-designer create pipeline.py --num-records 500

# SDG Hub 8 harm-category policy concepts
# Categories: Illegal Activity, Hate Speech, Security & Malware, Violence,
#             Fraud, Sexually Explicit, Misinformation, Self Harm
BIAS_SPEC=sdg-hub-harm uv run data-designer create pipeline.py --num-records 400

# All 13 categories combined (Singapore 5 + harm 8)
# Most diverse single run — covers both subtle cultural bias and explicit harm
BIAS_SPEC=combined uv run data-designer create pipeline.py --num-records 800

Comparison Spec Modes (Two-Group)

# US vs Mexico — national identity + race/ethnicity bias
BIAS_SPEC=us-mexico uv run data-designer create pipeline.py --num-records 200

# US (mainland) vs Puerto Rico — citizenship + national identity
BIAS_SPEC=us-puerto-rico uv run data-designer create pipeline.py --num-records 200

# US White vs US Brown/Latino — intra-US racial bias
BIAS_SPEC=us-white-brown uv run data-designer create pipeline.py --num-records 200

Generating Diverse Datasets

Run multiple modes and merge results for maximum probe coverage:

uv run python examples/diverse_dataset.py --preview-only   # sanity check first
uv run python examples/diverse_dataset.py                  # generates ~720 probes

This runs Singapore + SDG Hub harm + US-Mexico + US White/Brown and merges into diverse_red_team_dataset.jsonl (Garak-compatible format).

Customize runs by editing the runs list in examples/diverse_dataset.py:

runs = [
    ("singapore", build_cultural_bias_pipeline(), 200),
    ("sdg-hub-harm", build_harm_pipeline(), 320),
    ("combined", build_combined_pipeline(), 500),  # or use this for broadest coverage
    ("us-mexico", build_comparison_pipeline(load_spec("us-mexico")), 100),
    ("us-white-brown", build_comparison_pipeline(load_spec("us-white-brown")), 100),
]

Available Modes and Specs

Adding a New Comparison

Create interplay/specs/<name>.py that exports SPEC = BiasComparisonSpec(...). No other files need to change.

# After creating the file:
uv run pytest                # validates the spec format
# Open a PR — CI runs automatically

Full instructions: interplay/specs/CONTRIBUTING.md

Output (Probe Generation)

Each probe row includes:

In comparison mode, also includes group_1_name, group_2_name, group_1_ref, group_2_ref, comparison_topic.

Attack Methodologies (Detailed)

Each methodology has its own page with parameters and a runnable example.

Configuration

Environment Variables

Create a .env file in the repo root:

# Target endpoint configuration
TARGET_URL=https://your-target/v1
TARGET_API_KEY=your-api-key
TARGET_MODEL=your-model-name

# Judge model (for scoring)
JUDGE_URL=https://your-target/v1
JUDGE_API_KEY=your-api-key
JUDGE_MODEL=openai/gpt-4o-mini

# Attacker model (for TAP/PAIR/GOAT)
ATTACKER_URL=https://your-target/v1
ATTACKER_API_KEY=your-api-key
ATTACKER_MODEL=openai/gpt-4o-mini

# Provider configuration
LLM_PROVIDER=openai
API_KEY=your-api-key
BASE_URL=https://your-provider/v1

Supported Providers

All providers supported by any-llm-sdk:

• OpenAI (default)
• Anthropic
• Google (Gemini)
• Mistral
• Cohere
• Ollama (local)
• vLLM (local/custom)
• And 20+ more

Development

uv sync                     # install all deps
uv sync --extra red-teaming  # + attack methodology deps (--extra garak for the Garak scanner)
uv run ruff check .         # lint
uv run ruff format .        # format
uv run pytest               # unit tests (no LLM required)

Using with RHOAI / vLLM

export OPENAI_BASE_URL=https://your-vllm-endpoint/v1
export OPENAI_API_KEY=your-key
export MODEL_NAME=granite-3.3-8b-instruct

uv run data-designer create pipeline.py --num-records 500

# Or for attack methodologies:
export TARGET_URL=https://your-vllm-endpoint/v1
export TARGET_API_KEY=your-key
export ATTACKER_MODEL=granite-3.3-8b-instruct

uv run python examples/integrated_run.py --probe-file probes.jsonl

Methodology

Interplay combines culturally grounded probe generation (the Singapore AI Safety Red Teaming Challenge approach, IMDA and Humane Intelligence, February 2025) with seven attack methodologies that cover different search strategies, from static probe libraries to multi-turn and multimodal attacks. How they work, when to use each, how they combine, and the references are in docs/METHODOLOGY.md.

Security and content policy

This project contains adversarial material. Read the content policy before contributing, and report vulnerabilities privately as described in SECURITY.md. Use it only against systems you own or are authorized to test.

License

Apache 2.0