Skip to main content

harbor-dsh-evolution

Harbor-side integration for both DeepSeek Harness Candidate evaluation and privacy-preserving Historical Generation Evaluation.

It provides:

  • DshCandidateAgent: verifies and uploads an immutable Candidate, installs its locked npm dependencies, and runs it through Harbor's ACP runner.
  • EvolutionPlugin: binds each Job to Candidate, Dataset Manifest, Evaluation Stack Manifest, Context v2, Architecture Doctor, Trial assessments, Population report, and Summary.
  • SessionObservationAgent: presents one frozen, redacted DSH Session Observation as one deterministic Harbor Trial without rerunning a Candidate.
  • HistoricalGenerationEvaluationPlugin: validates the immutable Historical Batch/Dataset/Stack cross-links, runs Evaluator v2, preserves completed-unscored abstention, and writes Summary v4 plus a strict completion sentinel. Historical Jobs are diagnostic and cannot enter Promotion Gate.
  • harbor-dsh: initializes strict projects; validates/snapshots Candidates, Datasets, and Stacks; materializes Historical Batch inputs; previews Context v2; diagnoses architecture; summarizes Jobs; and runs the deterministic Promotion Gate.

Install it into the same Python environment as Harbor so the plugin entry point is discoverable:

uv venv .venv
uv pip install --python .venv/bin/python harbor-dsh-evolution==0.9.3
source .venv/bin/activate
harbor plugins list
harbor-dsh --help

The plugin list must contain both entry points:

dsh-evolution
dsh-historical-evaluation

Development from this repository:

uv sync
uv run harbor plugins list
uv run harbor-dsh --help
uv run harbor-dsh historical --help
uv run harbor-dsh dataset validate ../../examples/deep-research/task --project-root ../..
uv run harbor-dsh stack validate ../../examples/deep-research/.harbor/evaluation-stack.yml --project-root ../..
uv run pytest
uv build

Harbor and this package must be installed into the same Python environment for the dsh-evolution and dsh-historical-evaluation entry points to appear in harbor plugins list.

snapshot derives Candidate id and version from package.json unless explicitly supplied. Context v1 is not accepted. Candidate promotion requires Context v2 and emits structured mismatch, artifact, infrastructure, metric, and regression reason codes. Historical materialization instead derives a matching Dataset and immutable Stack from a redacted historical-generation-batch/v1; it never creates a Candidate identity, reports insufficient evidence as completed-unscored, and always returns UNSUPPORTED_JOB_KIND_FOR_PROMOTION if passed to Gate.

Release files for harbor-dsh-evolution 0.9.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for harbor-dsh-evolution 0.9.3
File Size Uploaded
harbor_dsh_evolution-0.9.3.tar.gz 284.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for harbor-dsh-evolution 0.9.3
File Interpreter ABI Platform
harbor_dsh_evolution-0.9.3-py3-none-any.whl Python 3 none any Details

Total release size: 403.7 kB

Release files / harbor_dsh_evolution-0.9.3.tar.gz

Download URL harbor_dsh_evolution-0.9.3.tar.gz
Size 284.2 kB
Tags Source
SHA-256 checksum
How to use checksums
d53fdeaaf3b480cbcd22fc6f1c8e339be07289a97d11e9ace5d85d0627dda19f
BLAKE2b-256 checksum
How to use checksums
923c9cf45f84a743906a756b49179cf4aa242bf79b20a942a8b6a7be6dbb98f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 6, 2026.

Transparency log

Release files / harbor_dsh_evolution-0.9.3-py3-none-any.whl

Download URL harbor_dsh_evolution-0.9.3-py3-none-any.whl
Size 119.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
ff0eb05021ec9e804dda4b21fb491f5390db2f8340cb3ed5e0bcfa8bf0125d42
BLAKE2b-256 checksum
How to use checksums
8ca8e781e84de3bd1846255ee6cd199b5a4c43f53a5fe4c63c9503528adeaeb7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 6, 2026.

Transparency log

Release history Release notifications | RSS feed

0.10.1

2 release files

0.9.8

2 release files

0.9.7

2 release files

0.9.6

2 release files

0.9.5

2 release files

0.9.4

2 release files

This release

0.9.3 This release

2 release files

0.9.2

2 release files

0.9.0

2 release files

0.8.3

2 release files

0.8.2

2 release files

0.8.1

2 release files

0.8.0

2 release files

0.7.3

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7.0

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.0

2 release files

0.4.0

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.0

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page