Skip to main content

Hawk

Hawk is a platform for running Inspect AI evaluations at scale on cloud infrastructure. You describe the tasks, agents, and models to evaluate in a YAML config, and Hawk handles the rest: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, importing results into a PostgreSQL warehouse, and serving a web UI to browse them. It also runs Inspect Scout scans over transcripts from completed evaluations.

📚 Full documentation: hawk.metr.org

Install the CLI

Install from PyPI with uv (or pip):

uv tool install "hawk[cli]"   # or: pip install "hawk[cli]"

See the installation guide for pinning to a deployment and installing from source.

Python client

pip install "hawk[client]"
import asyncio
from hawk.client import HawkClient

async def main() -> None:
    async with HawkClient() as client:
        print(await client.get_jobs(mine=True, limit=5))

asyncio.run(main())

Uses HAWK_API_URL and a token from token=, HAWK_ACCESS_TOKEN, or hawk login. Does not prompt for login. See the installation guide and the Python client API.

Run your first eval

export HAWK_API_URL=https://api.hawk.example.com   # your Hawk deployment
hawk login
hawk eval-set my-eval-set.yaml   # write your own, or grab an example from the repo's hawk/examples/
hawk logs -f    # watch it run
hawk web        # open results in the browser

See Running Evaluations for a ready-to-run example config.

Documentation

License

MIT

Metadata

Release files for hawk 3.7.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hawk 3.7.1
File Size Uploaded
hawk-3.7.1.tar.gz 4.6 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for hawk 3.7.1
File Interpreter ABI Platform
hawk-3.7.1-py3-none-any.whl Python 3 none any Details

Total release size: 5.8 MB

Release files / hawk-3.7.1.tar.gz

Download URL hawk-3.7.1.tar.gz
Size 4.6 MB
Tags Source
SHA-256 checksum
How to use checksums
0871e82216c87336ff2c25ed437cb52295c0e07101ca20592c353f4cab52c899
BLAKE2b-256 checksum
How to use checksums
69f180fbd407e7ea5b2a7633165aea5123e5ac1652d782b3e80136ab4b4b5fbc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 7, 2026.

Transparency log

Release files / hawk-3.7.1-py3-none-any.whl

Download URL hawk-3.7.1-py3-none-any.whl
Size 1.2 MB
Tags Python 3
SHA-256 checksum
How to use checksums
7bcd79c5ec8c06794b899a1f02fc67ef43e08fadc4f5f99fb2f7e8e0309ff915
BLAKE2b-256 checksum
How to use checksums
d71b288a7bdb6192c8dd3b572c92624c2d57855e25c2ff90e71a2b50f45a45cf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 7, 2026.

Transparency log

Release history Release notifications | RSS feed

3.7.2

2 release files

This release

3.7.1 This release

2 release files

3.7.0

2 release files

3.6.0

2 release files

3.5.0

2 release files

3.4.0

2 release files

3.3.1

2 release files

3.3.0

2 release files

3.2.0

2 release files

3.1.1

2 release files

3.1.0

2 release files

3.0.0

2 release files

2.6.0

2 release files

2.5.0

2 release files

2.4.0

2 release files

2.3.0

2 release files

2.2.0

2 release files

2.1.0

2 release files

2.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page