Hawk

Hawk is a platform for running Inspect AI evaluations at scale on cloud infrastructure. You describe the tasks, agents, and models to evaluate in a YAML config, and Hawk handles the rest: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, importing results into a PostgreSQL warehouse, and serving a web UI to browse them. It also runs Inspect Scout scans over transcripts from completed evaluations.

📚 Full documentation: hawk.metr.org

Install the CLI

To install the CLI from GitHub, use the install command in the main README.

Run your first eval

export HAWK_API_URL=https://api.hawk.example.com   # your Hawk deployment
hawk login
hawk eval-set my-eval-set.yaml   # write your own, or grab an example from the repo's hawk/examples/
hawk logs -f    # watch it run
hawk web        # open results in the browser

See Running Evaluations for a ready-to-run example config.

Documentation

License

MIT

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (2.3.0)

Owner

PyPI data
Data sourced directly from PyPI's database.

Requires

Python >=3.13

Provides Extra

api cli core core-aws core-db core-eval-import core-scan-import inspect inspect-scout janitor runner tracing

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hawk-2.2.0.tar.gz (2.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hawk-2.2.0-py3-none-any.whl (564.6 kB view details)

Uploaded Python 3

File details

Details for the file hawk-2.2.0.tar.gz.

File metadata

  • Download URL: hawk-2.2.0.tar.gz
  • Upload date:
  • Size: 2.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for hawk-2.2.0.tar.gz
Algorithm Hash digest
SHA256 5808f77e458ca2d4abf1ea433d14f6ba98cb1e33024bf2e0ee12285414de729c
MD5 81e595206bbd8771f7cd3d9f3508eaf3
BLAKE2b-256 54cbcae992e9b9531f89202d9dc75668c80798428800a5e2d04e9674c1d35d5a

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.2.0.tar.gz:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file hawk-2.2.0-py3-none-any.whl.

File metadata

  • Download URL: hawk-2.2.0-py3-none-any.whl
  • Upload date:
  • Size: 564.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for hawk-2.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 656ad3f2b9a09586325038e896f62beb6b8c3d6adeb228cdee321417f3df58aa
MD5 d5f3dbfe8e696651480351122a70d79f
BLAKE2b-256 a99e59a0a7c264836862d48cc177fed815260ceb5a4db70633d7c55caca52381

See more details on using hashes here.

Provenance

The following attestation bundles were made for hawk-2.2.0-py3-none-any.whl:

Publisher: publish-pypi.yml on METR/hawk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page