Hawk

Hawk is a platform for running Inspect AI evaluations at scale on cloud infrastructure. You describe the tasks, agents, and models to evaluate in a YAML config, and Hawk handles the rest: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, importing results into a PostgreSQL warehouse, and serving a web UI to browse them. It also runs Inspect Scout scans over transcripts from completed evaluations.

📚 Full documentation: hawk.metr.org

Install the CLI

To install the CLI from GitHub, use the install command in the main README.

Run your first eval

export HAWK_API_URL=https://api.hawk.example.com   # your Hawk deployment
hawk login
hawk eval-set my-eval-set.yaml   # write your own, or grab an example from the repo's hawk/examples/
hawk logs -f    # watch it run
hawk web        # open results in the browser

See Running Evaluations for a ready-to-run example config.

Documentation

License

MIT

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2.3.0)

Owner

PyPI data
Data sourced directly from PyPI's database.

Requires

Python >=3.13

Provides Extra

api cli core core-aws core-db core-eval-import core-scan-import inspect inspect-scout janitor runner tracing

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hawk-2.0.0.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hawk-2.0.0-py3-none-any.whl (499.7 kB view details)

Uploaded Python 3

File details

Details for the file hawk-2.0.0.tar.gz.

File metadata

  • Download URL: hawk-2.0.0.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for hawk-2.0.0.tar.gz
Algorithm Hash digest
SHA256 96e8f6d425b83fcd8cae9cc237a0df83c98277edece76a79205c59ccee8ef7de
MD5 4c0a34f41b1dabd2195af0c47d0ac685
BLAKE2b-256 06234ebd37df9e47aa49a961ccb7fcc2fea3c8d0a822d425fbb3b88f57491a6d

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.0.0.tar.gz:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file hawk-2.0.0-py3-none-any.whl.

File metadata

  • Download URL: hawk-2.0.0-py3-none-any.whl
  • Upload date:
  • Size: 499.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for hawk-2.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 72ff69e12bdefb6dad651636044545c7746c43f7693625a8c765ad35f7b1c4c2
MD5 fdbcbe1b45a140cfad9f2670f1f833cf
BLAKE2b-256 81aba608e2a515d59881dd68f367744a6f9d9e186edbc4164e2bc70a97c9b70d

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.0.0-py3-none-any.whl:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page