Skip to main content

Signed manifest envelope for eval runs.

Project description

eval-run-manifest

A JSON envelope for eval run provenance, environment, code SHA, judge card, contamination report, dataset cards, result digest, and optional signatures.

Quickstart

pip install eval-run-manifest
eval-run-manifest build examples --out manifest.json
eval-run-manifest sign manifest.json --out manifest.signed.json
eval-run-manifest validate examples/judge_bench_manifest.json

Reference manifests are included for synthetic judge-bench and eval-adapter runs. Signing is optional; for Sigstore, create a bundle with your normal Sigstore workflow and attach it with eval-run-manifest sign manifest.json --sigstore-bundle bundle.json --out manifest.signed.json.

What This Is Not

Signing is optional and this package does not require AuraOne services. Examples are synthetic.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

eval_run_manifest-0.1.1.tar.gz (4.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

eval_run_manifest-0.1.1-py3-none-any.whl (5.5 kB view details)

Uploaded Python 3

File details

Details for the file eval_run_manifest-0.1.1.tar.gz.

File metadata

  • Download URL: eval_run_manifest-0.1.1.tar.gz
  • Upload date:
  • Size: 4.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for eval_run_manifest-0.1.1.tar.gz
Algorithm Hash digest
SHA256 bc0741e600dc11e80831da39f6a78686980e1a82392ad91526ad6f5bee6e4017
MD5 78eb70fb1a9bd7de4c72acb3198f3266
BLAKE2b-256 24141e1038d8a1c031c3736985be9a54048e08f0fc5364e4af85331294a14df2

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_run_manifest-0.1.1.tar.gz:

Publisher: release-python.yml on auraoneai/eval-run-manifest

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_run_manifest-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for eval_run_manifest-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 59c1d198e0daf41b9305bf94dfd0f6929a5ea8f1fe776f06e299eaa740d898d4
MD5 b1fdbcb51bac9778a1f8f5e605170caf
BLAKE2b-256 07c508041a0b8b2bf73531f8d8089093fb0ebeda1e7ac882a542769c05235bf5

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_run_manifest-0.1.1-py3-none-any.whl:

Publisher: release-python.yml on auraoneai/eval-run-manifest

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page