Hawk

Hawk is a platform for running Inspect AI evaluations at scale on cloud infrastructure. You describe the tasks, agents, and models to evaluate in a YAML config, and Hawk handles the rest: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, importing results into a PostgreSQL warehouse, and serving a web UI to browse them. It also runs Inspect Scout scans over transcripts from completed evaluations.

📚 Full documentation: hawk.metr.org

Install the CLI

Install from PyPI with uv (or pip):

uv tool install "hawk[cli]"   # or: pip install "hawk[cli]"

See the installation guide for pinning to a deployment and installing from source.

Run your first eval

export HAWK_API_URL=https://api.hawk.example.com   # your Hawk deployment
hawk login
hawk eval-set my-eval-set.yaml   # write your own, or grab an example from the repo's hawk/examples/
hawk logs -f    # watch it run
hawk web        # open results in the browser

See Running Evaluations for a ready-to-run example config.

Documentation

License

MIT

Project links

Data verified by PyPI on
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

Owner

PyPI data
Data sourced directly from PyPI's database.

Credits

Author: METR

GitHub Statistics

Data verified by PyPI on 
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

MIT
View SPDX License List

Requires

Python >=3.13

Provides Extra

api cli core core-aws core-db core-eval-import core-scan-import inspect inspect-scout janitor runner tracing

Tags

ai-safety evaluations inspect kubernetes llm

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hawk-2.3.0.tar.gz (3.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hawk-2.3.0-py3-none-any.whl (658.9 kB view details)

Uploaded Python 3

File details

Details for the file hawk-2.3.0.tar.gz.

File metadata

  • Download URL: hawk-2.3.0.tar.gz
  • Upload date:
  • Size: 3.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for hawk-2.3.0.tar.gz
Algorithm Hash digest
SHA256 c4ecee2bcf1864dca5da4b627f90f40d332a9165bd55dc01bd715526dd7a7954
MD5 04887552db7fe86cf22cb669cd76567f
BLAKE2b-256 7275158ca2b88c82010787876aee36ff471b57f64eeb51a75656c5fa6ccedde8

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.3.0.tar.gz:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file hawk-2.3.0-py3-none-any.whl.

File metadata

  • Download URL: hawk-2.3.0-py3-none-any.whl
  • Upload date:
  • Size: 658.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for hawk-2.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 40b004b3549ab089e2d4ad916cf32aeb879f60f3def90b947fd609bd4b1e639b
MD5 e69340865c1a5b7a8270490361cadc7b
BLAKE2b-256 7305951103e204649597839528e73081225ccf908a15289a72feeccc921f3b57

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.3.0-py3-none-any.whl:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page