judge-card

Turn LLM judge diagnostics into a portable disclosure card that reviewers can inspect and archive.

judge-card is for evaluation owners, auditors, and release reviewers who need a small, stable record of the judge model, diagnostic summary, known bias signals, recommended use, generation time, and synthetic-data disclosure. It validates the card shape and renders the same evidence as JSON, Markdown, or HTML.

Inspectable Output

judge-card generate reads a judge-bench-shaped JSON report and writes:

  • .json: the structured Judge Card.
  • .md: a review-ready Markdown disclosure.
  • .html: a standalone HTML document containing the Markdown evidence.

Every generated card includes a 64-character prompt_hash field computed from the sorted input results payload, plus the probe summary and known-bias rows. validate emits JSON with ok and explicit schema errors.

Runtime Boundary

Generation and validation operate only on local JSON files. The package has no runtime dependencies, network requests, model calls, telemetry, or hosted storage.

Install

python -m pip install judge-card==0.1.2

For development from a clone:

python -m pip install -e .

Quickstart

From a repository checkout:

judge-card generate --from examples/judge_bench_output.json --out judge-card.json
judge-card generate --from examples/judge_bench_output.json --out judge-card.md
judge-card validate judge-card.json

The schema is available at spec/judge-card-schema-v1.json, with synthetic examples under examples/.

Release Status

Registry status verified July 13, 2026: version 0.1.2 is published on PyPI and tagged v0.1.2 in the public repository. The project is alpha software. No model endorsement, certification, or adoption claim is made.

Limits

A Judge Card discloses the supplied diagnostic evidence; it does not independently test a model, verify a provider, certify a judge, or establish benchmark quality.

Next Action

Generate JSON and Markdown cards from the matching judge-bench report, review the model id, prompt hash, bias rows, and recommended use, then attach the JSON card to the corresponding eval-run manifest.

Project links

Data verified by PyPI on Jul 13, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for auraoneai from gravatar.com auraoneai

Credits

Author: AuraOne

GitHub Statistics

Data verified by PyPI on Jul 13, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

MIT
View SPDX License List

Requires

Python >=3.10

Tags

llm-as-judge judge-card model-evaluation ai-governance evals disclosure

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

judge_card-0.1.2.tar.gz (6.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

judge_card-0.1.2-py3-none-any.whl (6.4 kB view details)

Uploaded Python 3

File details

Details for the file judge_card-0.1.2.tar.gz.

File metadata

  • Download URL: judge_card-0.1.2.tar.gz
  • Upload date:
  • Size: 6.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for judge_card-0.1.2.tar.gz
Algorithm Hash digest
SHA256 45c357bb69f8f78fd5e8f59ea16a0b14467694958ac2d8e3ea2db4107a112152
MD5 e83b68b507621f856d8bfb9dc7672521
BLAKE2b-256 1c85a754749aa84201f18d1cd2d187be0e427ed9cea5c03ca91d97fd4f791db8

See more details on using hashes here.

Provenance

The following attestation bundles were made for judge_card-0.1.2.tar.gz:

Publisher: release-python.yml on auraoneai/judge-card

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file judge_card-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: judge_card-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 6.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for judge_card-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 91de09cf7c8875f6172701ea18c1d47ea92f252e920a97563600ec010fffc4bf
MD5 de8c5f2522c68e646d0febda93eaa383
BLAKE2b-256 c1af01558860a83acabe26f6996612a0526b2aa5e43d2e076e7b73e2e71c84b1

See more details on using hashes here.

Provenance

The following attestation bundles were made for judge_card-0.1.2-py3-none-any.whl:

Publisher: release-python.yml on auraoneai/judge-card

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.1.2 This release

2 files

0.1.1

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page