Skip to main content

harbor-dsh-evolution

Harbor-side integration for both DeepSeek Harness Candidate evaluation and privacy-preserving Historical Generation Evaluation.

It provides:

  • DshCandidateAgent: verifies and uploads an immutable Candidate, installs its locked npm dependencies, and runs it through Harbor's ACP runner.
  • EvolutionPlugin: binds each Job to Candidate, Dataset Manifest, Evaluation Stack Manifest, Candidate Context v3, Architecture Doctor, Trial assessments, Population report, and Summary.
  • SessionObservationAgent: presents one frozen, credential-redacted DSH Session Observation as one deterministic Harbor Trial without rerunning a Candidate; ordinary paths in visible source text are preserved.
  • HistoricalGenerationEvaluationPlugin: validates the immutable Historical Batch/Dataset/Stack cross-links, runs Evaluator v2, preserves completed-unscored abstention, and writes Summary v4 plus a strict completion sentinel. Historical Jobs are diagnostic and cannot enter Promotion Gate.
  • harbor-dsh: initializes strict projects; validates/snapshots Candidates, Datasets, and Stacks; materializes Historical Batch inputs; previews Candidate Context v3; diagnoses architecture; summarizes Jobs; and runs the deterministic Promotion Gate.

Install it into the same Python environment as Harbor so the plugin entry point is discoverable:

uv venv .venv
uv pip install --python .venv/bin/python harbor-dsh-evolution==0.9.8
source .venv/bin/activate
harbor plugins list
harbor-dsh --help

The plugin list must contain both entry points:

dsh-evolution
dsh-historical-evaluation

Development from this repository:

uv sync
uv run harbor plugins list
uv run harbor-dsh --help
uv run harbor-dsh historical --help
uv run harbor-dsh dataset validate ../../examples/deep-research/task --project-root ../..
uv run harbor-dsh stack validate ../../examples/deep-research/.harbor/evaluation-stack.yml --project-root ../..
uv run pytest
uv build

Harbor and this package must be installed into the same Python environment for the dsh-evolution and dsh-historical-evaluation entry points to appear in harbor plugins list.

snapshot derives Candidate id and version from package.json unless explicitly supplied. Context v1 is not accepted. Candidate promotion requires Context v3 and emits structured mismatch, artifact, infrastructure, metric, and regression reason codes. Historical materialization instead derives a matching Dataset and immutable Stack from a credential-redacted historical-generation-batch/v1; it never creates a Candidate identity, reports insufficient evidence as completed-unscored, and always returns UNSUPPORTED_JOB_KIND_FOR_PROMOTION if passed to Gate.

Release files for harbor-dsh-evolution 0.9.8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for harbor-dsh-evolution 0.9.8
File Size Uploaded
harbor_dsh_evolution-0.9.8.tar.gz 290.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for harbor-dsh-evolution 0.9.8
File Interpreter ABI Platform
harbor_dsh_evolution-0.9.8-py3-none-any.whl Python 3 none any Details

Total release size: 415.9 kB

Release files / harbor_dsh_evolution-0.9.8.tar.gz

Download URL harbor_dsh_evolution-0.9.8.tar.gz
Size 290.6 kB
Tags Source
SHA-256 checksum
How to use checksums
6a4c740dc0713e4f1471892d358d1917029a468f511e49f11923b0458c9a3611
BLAKE2b-256 checksum
How to use checksums
dd8cec55e9e0c49bd4ec4570d4a5539125ed8fb613c3a9f308e599a783ecc009
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 21, 2026.

Transparency log

Release files / harbor_dsh_evolution-0.9.8-py3-none-any.whl

Download URL harbor_dsh_evolution-0.9.8-py3-none-any.whl
Size 125.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
6084fff1cce4cca8b69cca3c025ffbdb1544dadfb67d7f91731b5bd7e6a0625f
BLAKE2b-256 checksum
How to use checksums
9c76a18a18226f2841aeb021b52263d8ef98ee2f376859fe20facafdbfb6b07f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 21, 2026.

Transparency log

Release history Release notifications | RSS feed

0.10.1

2 release files

This release

0.9.8 This release

2 release files

0.9.7

2 release files

0.9.6

2 release files

0.9.5

2 release files

0.9.4

2 release files

0.9.3

2 release files

0.9.2

2 release files

0.9.0

2 release files

0.8.3

2 release files

0.8.2

2 release files

0.8.1

2 release files

0.8.0

2 release files

0.7.3

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7.0

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.0

2 release files

0.4.0

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.0

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page