Hawk

Hawk is a platform for running Inspect AI evaluations at scale on cloud infrastructure. You describe the tasks, agents, and models to evaluate in a YAML config, and Hawk handles the rest: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, importing results into a PostgreSQL warehouse, and serving a web UI to browse them. It also runs Inspect Scout scans over transcripts from completed evaluations.

📚 Full documentation: hawk.metr.org

Install the CLI

Install from PyPI with uv (or pip):

uv tool install "hawk[cli]"   # or: pip install "hawk[cli]"

See the installation guide for pinning to a deployment and installing from source.

Run your first eval

export HAWK_API_URL=https://api.hawk.example.com   # your Hawk deployment
hawk login
hawk eval-set my-eval-set.yaml   # write your own, or grab an example from the repo's hawk/examples/
hawk logs -f    # watch it run
hawk web        # open results in the browser

See Running Evaluations for a ready-to-run example config.

Documentation

Installation — install the CLI and run your first eval
Running Evaluations — eval set configs, secrets, local runs
Running Scans — Inspect Scout scans over transcripts
CLI Reference — full command reference
Deploy your own Hawk — stand up a Hawk instance on AWS
Contributing — developer setup and testing

License

MIT

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hawk-2.5.0.tar.gz (3.6 MB view details)

Uploaded Aug 27, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

hawk-2.5.0-py3-none-any.whl (806.0 kB view details)

Uploaded Aug 27, 2026 Python 3

File details

Details for the file hawk-2.5.0.tar.gz.

File metadata

Download URL: hawk-2.5.0.tar.gz
Upload date: Aug 27, 2026
Size: 3.6 MB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for hawk-2.5.0.tar.gz
Algorithm	Hash digest
SHA256	`4301a2cb56887afb82a8471ac1ff620b3d907c15a9ac4d0ee324cd5bcbcf6981`
MD5	`c80f941740b6a38becae10615d2d9949`
BLAKE2b-256	`e1840c9080583d09d9937946224e1ebf3462fc9f7e5e0697ac36bc57c247e988`

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.5.0.tar.gz:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: hawk-2.5.0.tar.gz
- Subject digest: 4301a2cb56887afb82a8471ac1ff620b3d907c15a9ac4d0ee324cd5bcbcf6981
- Sigstore transparency entry: 2618204177
- Sigstore integration time: Aug 27, 2026
Source repository:
- Permalink: METR/hawk@cfefb1eb59140a1388db6e106c644462d36045c4
- Branch / Tag: refs/tags/v2.5.0
- Owner: https://github.com/METR
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: publish-pypi.yml@cfefb1eb59140a1388db6e106c644462d36045c4
- Trigger Event: release