security-claim-agentdojo
A superred SecurityClaim package paired with agentdojo-target. Three composable layers:
- Layer 1: original AgentDojo injection tasks. One paired Task per canonical (user_task, injection_task) pair, 27 tasks total across the four AgentDojo suites (banking, workspace, slack, travel). Subdivided by attack-semantic category per the table the user confirmed. Benchmark version pinned to the latest released (
v1.2.2) via the target'sseed_loader.BENCHMARK_VERSION. - Layer 2: bespoke system-purpose-violation goals. Standalone goals tailored to the composite multi-suite agent. Deterministic security predicates, NOT LLM-as-judge. Each task carries a benign user prompt; the attacker chooses delivery based on scope.
- Layer 3: combined. Composition of Layers 1 and 2.
Install
# from the superred-modules repo root
pip install -e ./targets/agentdojo
pip install -e ./security_claims/agentdojo
Quick start
from agentdojo_target import AgentDojoTarget
from agentdojo_claim import agentdojo_layer1_claim
from superred.core.controller import Controller, TargetFactory
target_factory = TargetFactory(
create=lambda: AgentDojoTarget(
pipeline_model="openai/gpt-4o-2024-05-13",
api_base=BASE, api_key=KEY,
),
concurrency=1,
)
claim = agentdojo_layer1_claim() # all 27 canonical pairs
controller = Controller(
optimizer_factory=lambda: MyOptimizer(),
target_factory=target_factory,
security_claim=claim,
scope=frozenset({USER_TAG, TOOLS_TAG}), # example scope
)
await controller.run()
See ASSUMPTIONS.md for divergences from AgentDojo upstream and Layer-2 design rationale.
Status
v0.1.0 alpha. Public surface is unstable.
Credits / upstream
This package's source is original superred work (MIT, Copyright (c) 2026 Simon Sure). It bundles no third-party code or data.
Layer 1 adapts the AgentDojo
benchmark (Debenedetti et al., 2024; MIT, Copyright (c) 2024 Edoardo
Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer,
and Florian Tramèr). AgentDojo is a runtime dependency (agentdojo>=0.1.35),
installed from PyPI and not redistributed here; its injection/user tasks are
run and scored via superred's agentdojo-target. Please cite AgentDojo when
reporting Layer-1 results.
Layer 2 goals are bespoke, hand-authored superred content (deterministic
security predicates, not derived from AgentDojo's tasks). See ASSUMPTIONS.md.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file superred_claim_agentdojo-0.1.0.tar.gz.
File metadata
- Download URL: superred_claim_agentdojo-0.1.0.tar.gz
- Upload date:
- Size: 53.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fc93c748f99fa586ec77e59426df4a9b2da0a81f634ed0f22f53fa6f8c35eda5
|
|
| MD5 |
87838bc97568fcd8e10f9568b883eae0
|
|
| BLAKE2b-256 |
a157df33a3aef4ec2b30b45006485e7af133c111ba6cd4d6565098c2fc0c794b
|
Provenance
The following attestation bundles were made for superred_claim_agentdojo-0.1.0.tar.gz:
Publisher:
release.yml on RoldSI/superred-modules
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
superred_claim_agentdojo-0.1.0.tar.gz -
Subject digest:
fc93c748f99fa586ec77e59426df4a9b2da0a81f634ed0f22f53fa6f8c35eda5 - Sigstore transparency entry: 2219146710
- Sigstore integration time:
-
Permalink:
RoldSI/superred-modules@44b3a2514b4d75fe7ebc3f015aa13ff3b6e8380c -
Branch / Tag:
refs/tags/superred-claim-agentdojo-v0.1.0 - Owner: https://github.com/RoldSI
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@44b3a2514b4d75fe7ebc3f015aa13ff3b6e8380c -
Trigger Event:
push
-
Statement type:
File details
Details for the file superred_claim_agentdojo-0.1.0-py3-none-any.whl.
File metadata
- Download URL: superred_claim_agentdojo-0.1.0-py3-none-any.whl
- Upload date:
- Size: 46.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0eb90b3d56ff451c8b21472b38dacc0d080eec9ad47cf81803c191f5f323f69c
|
|
| MD5 |
1671ae46274945d4f8dfe02ef195a5ba
|
|
| BLAKE2b-256 |
6a79a08888555d6a4da3cf92796589e31a33abd2205b2aad83cdf1ba7f0fcd60
|
Provenance
The following attestation bundles were made for superred_claim_agentdojo-0.1.0-py3-none-any.whl:
Publisher:
release.yml on RoldSI/superred-modules
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
superred_claim_agentdojo-0.1.0-py3-none-any.whl -
Subject digest:
0eb90b3d56ff451c8b21472b38dacc0d080eec9ad47cf81803c191f5f323f69c - Sigstore transparency entry: 2219146746
- Sigstore integration time:
-
Permalink:
RoldSI/superred-modules@44b3a2514b4d75fe7ebc3f015aa13ff3b6e8380c -
Branch / Tag:
refs/tags/superred-claim-agentdojo-v0.1.0 - Owner: https://github.com/RoldSI
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@44b3a2514b4d75fe7ebc3f015aa13ff3b6e8380c -
Trigger Event:
push
-
Statement type: