Hawk

Hawk is a platform for running Inspect AI evaluations at scale on cloud infrastructure. You describe the tasks, agents, and models to evaluate in a YAML config, and Hawk handles the rest: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, importing results into a PostgreSQL warehouse, and serving a web UI to browse them. It also runs Inspect Scout scans over transcripts from completed evaluations.

📚 Full documentation: hawk.metr.org

Install the CLI

To install the CLI from GitHub, use the install command in the main README.

Run your first eval

export HAWK_API_URL=https://api.hawk.example.com   # your Hawk deployment
hawk login
hawk eval-set my-eval-set.yaml   # write your own, or grab an example from the repo's hawk/examples/
hawk logs -f    # watch it run
hawk web        # open results in the browser

See Running Evaluations for a ready-to-run example config.

Documentation

License

MIT

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2.3.0)

Owner

PyPI data
Data sourced directly from PyPI's database.

Requires

Python >=3.13

Provides Extra

api cli core core-aws core-db core-eval-import core-scan-import inspect inspect-scout janitor runner tracing

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hawk-2.1.0.tar.gz (2.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hawk-2.1.0-py3-none-any.whl (538.0 kB view details)

Uploaded Python 3

File details

Details for the file hawk-2.1.0.tar.gz.

File metadata

  • Download URL: hawk-2.1.0.tar.gz
  • Upload date:
  • Size: 2.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for hawk-2.1.0.tar.gz
Algorithm Hash digest
SHA256 aba8f9258eb0f2ba8a7715a2878c4e4d0448952a7903435f1fce6e5edb876d6f
MD5 4eb2ab3eb3638809f2e76dde9e711053
BLAKE2b-256 914553d5f76264d28f70b80b8c53a45836426fed5eac5e606622f56eaf423d3e

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.1.0.tar.gz:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file hawk-2.1.0-py3-none-any.whl.

File metadata

  • Download URL: hawk-2.1.0-py3-none-any.whl
  • Upload date:
  • Size: 538.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for hawk-2.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a8eb8ca9b8618c8b7da8dd633a5031edf7091b87ac2c26b969ff4cde99ef78ab
MD5 c3bfc332e8a7fb23e63603a1c806d99e
BLAKE2b-256 d75ef22b36aae5482310f3c1ea25625769bb544239cb51def9382a3e74f3d166

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.1.0-py3-none-any.whl:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page