Inspect Harbor
Harbor is a framework for building, evaluating, and optimizing AI agents in containerized environments. Inspect Harbor provides an interface to run Harbor tasks using Inspect AI.
pip install "inspect-harbor>=0.5"
Then in Python:
from inspect_ai import eval
from inspect_harbor import aider_polyglot
eval(aider_polyglot(), model="openai/gpt-5-mini")
Or load any dataset directly via the generic harbor() interface:
from inspect_ai import eval
from inspect_harbor import harbor
eval(
harbor(package_name="aider/aider-polyglot", package_ref="latest"),
model="openai/gpt-5-mini",
)
For full documentation, see https://meridianlabs-ai.github.io/inspect_harbor. The docs site covers installation, the Harbor task model, the default agent scaffold, task parameters, the generic harbor() interface (org/name and name@version datasets, plus local/git tasks), and a complete catalog of available datasets.
See CHANGELOG.md for release notes.
Development
Clone the repository and install development dependencies:
git clone https://github.com/meridianlabs-ai/inspect_harbor.git
cd inspect_harbor
make install # Installs dependencies and sets up pre-commit hooks
Run tests and checks:
make check # Run linting (ruff check + format) and type checking (pyright)
make test # Run tests
make cov # Run tests with coverage report
Clean up build artifacts:
make clean # Remove cache and build artifacts
Credits
This work is based on contributions by @iphan and @anthonyduong9 from the inspect_evals repository:
1 maintainer
Release files for inspect-harbor 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| inspect_harbor-1.0.0.tar.gz | 62.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| inspect_harbor-1.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 130.5 kB
Release files / inspect_harbor-1.0.0.tar.gz
| Download URL | inspect_harbor-1.0.0.tar.gz |
|---|---|
| Size | 62.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7b788e06b5382baec335d723a1061fe229159e1cde1933d046025cc4d178618b
|
|
BLAKE2b-256 checksum How to use checksums |
5d5c7e7b50aad657d9d6721624a02620bf0244ea0c8b8188dcb8bf4253c34cc2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 23, 2026.
Transparency logRelease files / inspect_harbor-1.0.0-py3-none-any.whl
| Download URL | inspect_harbor-1.0.0-py3-none-any.whl |
|---|---|
| Size | 68.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
669deb618c5e8dff13a66f08bfc25c3d3104e6741e56c52c471ea80a8b82abf3
|
|
BLAKE2b-256 checksum How to use checksums |
b0b6575dec5da4f483468f67ef0177417976fadce538423c3b4848590da41438
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 23, 2026.
Transparency log
