This release is a pre-release and may not be stable for production use.
Overview
verifiers is our library for creating environments to train and evaluate LLMs.
verifiers is tightly integrated with the Environments Hub, as well as our training framework prime-rl and our Hosted Training platform.
Installation
We recommend installing the Prime CLI to interact with the environments.
# install uv
curl -LsSf https://astral.sh/uv/install.sh | sh
# install the prime CLI
uv tool install prime
Further reading
- The docs contain short, human-written guides and overviews about the architecture.
- The AGENTS.md and skills are for coding agents and go into more details.
Contributing
We welcome community contributions. We use issues to track bugs and feature requests. If you hit a bug, a pain point, or have an idea for a feature, please open an issue.
Contributions are welcome via PR. Please follow these guidelines:
- Install the pre-commit hooks so your code is formatted and type-checked.
- Keep your PR in "Draft" until it is ready for review.
- If your PR resolves an issue, link the issue in the PR description.
- Run the tests for the areas you touched.
Pre-commit hooks
uv run pre-commit install
Tests
Unit tests run one component in isolation, with no network, and mirror the verifiers/v1 layout. Integration tests run real evals: they need PRIME_API_KEY and skip without it.
uv run pytest tests/unit -n auto # unit
uv run pytest tests/integration -n 8 # integration
uv run pytest tests/integration/test_single_turn.py # one behavior
uv run pytest tests/integration -m "docker and codex" # one runtime and harness
Citation
Originally created by Will Brown (@willccbb).
@misc{brown_verifiers_2025,
author = {William Brown},
title = {{Verifiers}: Environments for LLM Reinforcement Learning},
howpublished = {\url{https://github.com/PrimeIntellect-ai/verifiers}},
year = {2025}
}
1 maintainer
Metadata
1 maintainer
Release files for verifiers 0.4.1.dev23
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| verifiers-0.4.1.dev23.tar.gz | 444.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| verifiers-0.4.1.dev23-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 939.4 kB
Release files / verifiers-0.4.1.dev23.tar.gz
| Download URL | verifiers-0.4.1.dev23.tar.gz |
|---|---|
| Size | 444.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3b62ef2332db903294f61c3d30e4c7c471bc6cfd5ae413ca0720496ec08ac224
|
|
BLAKE2b-256 checksum How to use checksums |
8653f613ab897fa9a48c194cc989aae19fabc8deca2da716855a8b00994495ff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 15, 2026.
Transparency logRelease files / verifiers-0.4.1.dev23-py3-none-any.whl
| Download URL | verifiers-0.4.1.dev23-py3-none-any.whl |
|---|---|
| Size | 494.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ccd997cfdc3a1c17c1d24635a59de673519342b3379f9c4d9127685cdaca9395
|
|
BLAKE2b-256 checksum How to use checksums |
9b3492e744322956488a03d1455a5e5d484dfdba8a8eadae739f6886a0637dcd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 15, 2026.
Transparency log
