Skip to main content

Deterministic dispatch-only router for the ReleaseBench atomic release-readiness skill family.

Project description

ReleaseBench

License: MIT Candidate: private pre-public

ReleaseBench is a ten-skill atomic family for taking a private repository to the last evidence-backed checkpoint before outward publication. It separates local preparation from owner-gated host, release, registry, marketplace, installation, and public-verification actions.

This repository is a private, inactive candidate. It does not grant lifecycle eligibility.

Atomic family

Canonical skill One measurable outcome
releasebench-route Select exactly one next leaf or return no safe route.
releasebench-prepare-repository Produce one local repository-preparation receipt.
releasebench-audit-repository Produce one read-only repository-health gap report.
releasebench-scan-secrets Produce one redacted secret-hygiene risk report.
releasebench-scaffold-governance Produce one reviewable missing-governance diff.
releasebench-showcase-readme Produce one truthful showcase README diff.
releasebench-publish-repository Produce one closed-gate host and first-push handoff receipt.
releasebench-release-version Produce one local release-preparation receipt.
releasebench-prepare-package Produce one offline package dry-run receipt.
releasebench-document-config Produce one aligned schema, validator, and documentation diff.

The router dispatches only; it contains no leaf procedure. A full-flow request advances to the first incomplete applicable local stage. Ambiguous intent, missing dependency evidence, stale lifecycle state, or conflicting state returns a no-safe-route receipt.

The family also retains three internal, non-skill primitives: the shared lesson reader, plugin manifest, and portable agent guide.

Evidence, not traction

ReleaseBench has no public usage or download claim yet. Its proof is deliberately local and reproducible: the focused deterministic suite runs 19 product contracts with zero failures, zero errors, and zero skips; the plugin manifest validates; the bundled read-only auditor reports zero missing must-haves; and the Python package builds offline and passes its metadata check. These checks establish candidate integrity, not host, provider, registry, installation, marketplace, or public behavior.

Local validation

The focused deterministic suite verifies:

  • exact membership of ten canonical skills and three internal primitives;
  • the preserved 49-case eval corpus with per-leaf case IDs;
  • every positive trigger, every near miss, and all 36 pairwise direct-intent collisions;
  • deterministic typed routing, malformed-request failures, full-flow progression, and byte-equal CLI receipts;
  • retained support files, secret/private-path boundaries, and all eight closed outward actions.

Run the suite from any checkout:

python -B tests/releasebench/run_tests.py

The local GitLab CI definition runs this suite plus one syntax check per bundled Node script. Its job scripts contain no explicit provider, registry, marketplace, publication, or product-remote command. The runner may still resolve the external floating container images declared by the jobs, so hosted CI is externally gated, unverified, and not claimed as offline-deterministic evidence. A full local qualification additionally runs:

claude.cmd plugin validate .
git diff --check HEAD
git fsck --strict --no-reflogs

Then parse all JSON, run node --check on every .mjs, and replay the exact staged tree from a fresh worktree. The producing lane does not self-certify; a fresh independent critic must verify the frozen bytes before any commit or lifecycle decision. See the validation contract.

Flow

flowchart LR
  A["Private repository"] --> B["Route one atomic outcome"]
  B --> C["Local preparation and evidence"]
  C --> D{"Focused validation passes?"}
  D -- "No" --> E["Stop with failure evidence"]
  D -- "Yes" --> F["Freeze candidate for independent critic"]
  F --> G{"New exact outward approval?"}
  G -- "No" --> H["Private pre-public stop"]
  G -- "Later" --> I["Separately gated owner action"]

Invocation

Load the local plugin from a clean checkout:

claude.cmd --plugin-dir .

Invoke the router:

/releasebench:releasebench-route

Or invoke one direct leaf, for example:

/releasebench:releasebench-scan-secrets

Codex metadata is bundled under each skill's agents/openai.yaml, but implicit invocation remains disabled for this inactive candidate.

Python package

The deterministic router is also packaged as an installable Python module with no runtime dependencies beyond the standard library:

pip install .

The releasebench console entry point (equivalently python -m releasebench or python -B src/releasebench/router.py) reads one typed JSON routing request from stdin or a file argument and writes one canonical routing receipt. Installing the package changes no skill lifecycle state and performs no outward action.

Source policy

New paths, receipts, invocations, and documentation use canonical IDs only. Installed source skills, imported packages, remotes, marketplaces, providers, and archives are not modified by this repository.

Closed actions

This candidate does not create a remote project, push, fetch, pull, tag, create a host Release, change visibility or host metadata, call a host/public API, check remote image reachability, query a registry, authenticate, publish a package, install or promote a skill, contact a provider, or perform a marketplace action. releasebench-publish-repository solely owns the first-host/first-push handoff but does not execute it.

Candidate status

The local release candidate is 0.1.0, matching the plugin manifest, the Python package metadata, and the changelog. Read readiness status, dependency contract, and owner handoff for the remaining gates. These files are local preparation artifacts, not proof of any host or public state.

Known limitation: the carried audit helper still checks GitHub-specific issue, pull-request, and CI paths. It therefore reports three recommended gaps even though this GitLab-oriented repository has GitLab issue templates, merge-request templates, and a local .gitlab-ci.yml. Those findings require host-aware triage; the helper still correctly reports zero missing must-haves. Host-aware governance detection remains future work.

Governance

ReleaseBench is available under the MIT License. Contributions follow CONTRIBUTING.md, the Code of Conduct, and private security reporting guidance. Planned work is recorded in ROADMAP.md.

Built by Rahul Krishna.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

releasebench-0.1.0.tar.gz (11.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

releasebench-0.1.0-py3-none-any.whl (9.0 kB view details)

Uploaded Python 3

File details

Details for the file releasebench-0.1.0.tar.gz.

File metadata

  • Download URL: releasebench-0.1.0.tar.gz
  • Upload date:
  • Size: 11.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for releasebench-0.1.0.tar.gz
Algorithm Hash digest
SHA256 338d5a879dc73354b3438e9c4915411d4cbea13e611fb8c7e15804f416eab76b
MD5 8e9202eb5b1841a620f890a8ae6c1622
BLAKE2b-256 8b2ed39e97bb812bc90ea42cbb4ad3721819e62b05e90471cd9558b4eebb9934

See more details on using hashes here.

File details

Details for the file releasebench-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: releasebench-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 9.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for releasebench-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 20c5027d5ed2a71825b181bdfef42d69b9d74b98a3d73624b0b6d174e9cc8bca
MD5 46a097deabcb4a03654d3470350b0121
BLAKE2b-256 e3b90705b5ba5865028cebeef748e73e293da441f6623e98d244a11761ce7f8b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page