agentdojo 0.1.0

A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents

AgentDojo: Benchmarking the Capabilities and Adversarial Robustness of LLM Agents

Quickstart

pip install agentdojo

If you want to use the prompt injection detector, you need to install the transformers extra:

pip install "agentdojo[transformers]"

Running the benchmark

The benchmark can be run with the benchmark script. Documentation on how to use the script can be obtained with the --help flag.

For example, to run the workspace suite on the tasks 0 and 1, with gpt-4o-2024-05-13 as the LLM, the tool filter as a defense, and the attacker with tool knowlege, run the following command:

python -m agentdojo.scripts.benchmark -s workspace -ut user_task_0 \
    -ut user_task_1 --model gpt-4o-2024-05-13 \
    --defense tool_filter --attacker tool_knowledge

To run the above, but on all suites and tasks, run the following:

python -m agentdojo.scripts.benchmark --model gpt-4o-2024-05-13 \
    --defense tool_filter --attacker tool_knowledge

Documentation of the Dojo

Take a look at our documentation.

Development set-up

Take a look at the development set-up docs.