Welcome to Inspect, a framework for large language model evaluations created by the UK AI Security Institute.
Inspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g. to support new elicitation and scoring techniques) can be provided by other Python packages.
To get started with Inspect, please see the documentation at https://inspect.aisi.org.uk/.
Inspect also includes a collection of over 200 pre-built evaluations ready to run on any model (learn more at https://inspect.aisi.org.uk/evals/).
Coding agents: a structured index of the docs is published at https://inspect.aisi.org.uk/llms.txt. The user guide is concatenated as Markdown at https://inspect.aisi.org.uk/llms-guide.txt, and https://inspect.aisi.org.uk/llms-full.txt additionally bundles the API and CLI reference. Individual pages are available as Markdown by appending
.mdto the.htmlpath (e.g./extensions/index.html.md).
To work on development of Inspect, install uv (0.11.8 or later), clone the repository, and sync the development environment from the checked-in lockfile:
git clone https://github.com/UKGovernmentBEIS/inspect_ai.git
cd inspect_ai
uv sync
This installs Inspect in editable mode with its development dependencies at the versions recorded in uv.lock. Project dependencies are declared in requirements*.txt and exposed through pyproject.toml. When changing dependencies, update the appropriate requirements file and run uv lock rather than relying on uv add. uv only resolves releases that are at least seven days old, except for model provider SDKs and Inspect's own packages; see CONTRIBUTING.md for how to adopt a newer release.
Optionally install pre-commit hooks via
make hooks
Run linting, formatting, and tests via
make check
make test
Prefix those commands with uv run (for example, uv run make check), or activate the environment in .venv first.
If you use VS Code, you should be sure to have installed the recommended extensions (Python, Ruff, and MyPy). Note that you'll be prompted to install these when you open the project in VS Code.
Frontend development (TypeScript)
The web UI lives in a git submodule at src/inspect_ai/_view/ts-mono/. These steps are only needed if you plan to work on the TypeScript/React frontend — Python-only contributors can skip this entirely.
Initialize the submodule and install dependencies — see the one-time setup guide.
Documentation
To work on the Inspect documentation, sync the optional doc dependencies and build the docs:
uv sync --extra doc
cd docs
uv run quarto render # or 'uv run quarto preview'
If you intend to work on the docs iteratively, you'll want to install the Quarto extension in VS Code.
3 maintainers
Metadata
3 maintainers
Release files for inspect-ai 0.3.284
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| inspect_ai-0.3.284.tar.gz | 36.6 MB | With provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| inspect_ai-0.3.284-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 71.8 MB
Release files / inspect_ai-0.3.284.tar.gz
| Download URL | inspect_ai-0.3.284.tar.gz |
|---|---|
| Size | 36.6 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a5b185689bc2086eb4d0308eadcdea98b371bc57cd6a6b87e44535f31dea57e0
|
|
BLAKE2b-256 checksum How to use checksums |
d0754ca7620abad00d875cc89d147286e451bd2f049b05106977846fb0e1a9ff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 25, 2026.
Transparency logRelease files / inspect_ai-0.3.284-py3-none-any.whl
| Download URL | inspect_ai-0.3.284-py3-none-any.whl |
|---|---|
| Size | 35.2 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
dab5d26141295f7c0dcf78eb35a931244ee47b7db81742a09bb7090b7b13b323
|
|
BLAKE2b-256 checksum How to use checksums |
f2fc6b488dcedbd5210b86b7635aadcc85404a2685d81d3414983db65132018a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 25, 2026.
Transparency logSecurity for inspect-ai 0.3.284
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 2 files in this release have been uploaded with provenance metadata.
Attestation for inspect_ai-0.3.284.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 25, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
