Inspect Harbor

Harbor is a framework for building, evaluating, and optimizing AI agents in containerized environments. Inspect Harbor provides an interface to run Harbor tasks using Inspect AI.

pip install inspect-harbor

Then in Python:

from inspect_ai import eval
from inspect_harbor import aider_polyglot

eval(aider_polyglot(), model="openai/gpt-5-mini")

Or load any dataset directly via the generic harbor() interface:

from inspect_ai import eval
from inspect_harbor import harbor

eval(
    harbor(package_name="aider/aider-polyglot", package_ref="latest"),
    model="openai/gpt-5-mini",
)

For full documentation, see https://meridianlabs-ai.github.io/inspect_harbor. The docs site covers installation, the Harbor task model, the default agent scaffold, task parameters, the generic harbor() interface (org/name and name@version datasets, plus local/git tasks), and a complete catalog of available datasets.

See CHANGELOG.md for release notes.

Development

Clone the repository and install development dependencies:

git clone https://github.com/meridianlabs-ai/inspect_harbor.git
cd inspect_harbor
make install  # Installs dependencies and sets up pre-commit hooks

Run tests and checks:

make check    # Run linting (ruff check + format) and type checking (pyright)
make test     # Run tests
make cov      # Run tests with coverage report

Clean up build artifacts:

make clean    # Remove cache and build artifacts

Credits

This work is based on contributions by @iphan and @anthonyduong9 from the inspect_evals repository:

Project links

Data verified by PyPI on Aug 17, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.7.4)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for jjallaire from gravatar.com jjallaire

Credits

Author: Meridian Labs

GitHub Statistics

Data verified by PyPI on Aug 17, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License

MIT License (MIT License)

Requires

Python >=3.12

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

inspect_harbor-0.7.3.tar.gz (36.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

inspect_harbor-0.7.3-py3-none-any.whl (38.2 kB view details)

Uploaded Python 3

File details

Details for the file inspect_harbor-0.7.3.tar.gz.

File metadata

  • Download URL: inspect_harbor-0.7.3.tar.gz
  • Upload date:
  • Size: 36.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for inspect_harbor-0.7.3.tar.gz
Algorithm Hash digest
SHA256 687877a8d81fd7eab854b5b0a16768fd4214be77d0e886b8f2c0540ffa91b74c
MD5 3ed7b59e97f00ee1c5f570fa329fd7d4
BLAKE2b-256 06da5cd23b9e62e2a66041e3e2fe93c061393010aab0362a079d6d92ab60fec3

See more details on using hashes here.

Provenance

The following attestation bundles were made for inspect_harbor-0.7.3.tar.gz:

Publisher: release.yaml on meridianlabs-ai/inspect_harbor

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file inspect_harbor-0.7.3-py3-none-any.whl.

File metadata

  • Download URL: inspect_harbor-0.7.3-py3-none-any.whl
  • Upload date:
  • Size: 38.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for inspect_harbor-0.7.3-py3-none-any.whl
Algorithm Hash digest
SHA256 502b19215af62eb1cdc5ae5d1da129da95fd440173eae1d5ecf074d3530ae656
MD5 144937ad790d9e39a5b629f251a74729
BLAKE2b-256 74bfb5ea56cbdd1df54f929f2a9d558143337a5c52c6e8a852cd13eca7fff106

See more details on using hashes here.

Provenance

The following attestation bundles were made for inspect_harbor-0.7.3-py3-none-any.whl:

Publisher: release.yaml on meridianlabs-ai/inspect_harbor

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.7.4

2 files

This release

0.7.3 This release

2 files

0.7.2

2 files

0.7.1

2 files

0.7.0

2 files

0.6.4

2 files

0.6.3

2 files

0.6.2

2 files

0.6.1

2 files

0.6.0

2 files

0.5.17

2 files

0.5.16

2 files

0.5.15

2 files

0.5.14

2 files

0.5.13

2 files

0.5.12

2 files

0.5.11

2 files

0.5.10

2 files

0.5.9

2 files

0.5.8

2 files

0.5.7

2 files

0.5.6

2 files

0.5.5

2 files

0.5.4

2 files

0.5.3

2 files

0.5.2

2 files

0.5.1

2 files

0.5.0

2 files

0.4.17

2 files

0.4.16

2 files

0.4.15

2 files

0.4.14

2 files

0.4.13

2 files

0.4.12

2 files

0.4.11

2 files

0.4.10

2 files

0.4.9

2 files

0.4.8

2 files

0.4.7

2 files

0.4.6

2 files

0.4.5

2 files

0.4.4

2 files

0.4.3

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

0.2.0

2 files

Pre-release

0.1.2.dev1

2 files

0.1.1

2 files

Pre-release

0.1.1.dev2

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page