Jailbreak Evaluation Framework (JEF)
JEF is a CVSS-like scoring system for quantifying LLM jailbreak tactics. It provides a structured, repeatable framework for stack-ranking jailbreak methods based on their real-world efficacy and risk, scoring across three dimensions:
- Model Impact Radius — How many models and vendors are affected
- Retargetability — How flexibly the tactic applies across content categories
- Output Fidelity — How accurate and detailed the resulting outputs are
Installation
pip install 0din-jef
Quick Start
from jef import tiananmen, meth, nerve_agent, harry_potter
# Score against standardized benchmarks (0-100)
result = tiananmen.score("LLM response text")
result = meth.score("LLM response text")
result = nerve_agent.score("LLM response text")
result = harry_potter.score("LLM output", "reference text")
# Compute composite JEF score (0-10)
from jef import calculator
jef_score = calculator(num_vendors=3, num_models=7, num_subjects=2, scores=[80, 75])
Documentation
For the full framework methodology, scoring algorithm, complete usage guide, and API reference, visit the JEF Documentation.
Resources
- Blog: Quantifying the Unruly — A Scoring System for Jailbreak Tactics
- Overview: Jailbreak Evaluation Framework
- JEF Calculator
- Standardized Testing (0DIN Researcher Authentication Required)
Releases
Releases are managed through GitHub Releases and automatically published to PyPI.
Release files for 0din-jef 0.8.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| 0din_jef-0.8.3.tar.gz | 116.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| 0din_jef-0.8.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 207.7 kB
Release files / 0din_jef-0.8.3.tar.gz
| Download URL | 0din_jef-0.8.3.tar.gz |
|---|---|
| Size | 116.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
289fb96fa8a71f0d191c43ab370ab59450889963dca11673d719fad48449c0d4
|
|
BLAKE2b-256 checksum How to use checksums |
412e848fbe0b931fb5ddf8ff4a0c740e8b52e6602360c785a1a49a23283c7752
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / 0din_jef-0.8.3-py3-none-any.whl
| Download URL | 0din_jef-0.8.3-py3-none-any.whl |
|---|---|
| Size | 91.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
5f0d6c7a6f72019d9619d24f2be1592f999fdc36ab1b0ba2cec689f5ce50f284
|
|
BLAKE2b-256 checksum How to use checksums |
3969773e071bf14f62bf70750814ae233fb678481466d2f4cbd49951c55d47cb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
