Skip to main content

Offline verifier for TGS custody manifests — per-asset provenance for AI training data

Project description

tgs-verify

tgs-verify is the open verifier for The Gray Systems custody manifests — the per-asset provenance record (origin, generator model and license, generation parameters, SHA-256 content fingerprint) that ships with every TGS training-data delivery. Point it at a manifest and the delivered files; it recomputes every fingerprint and tells you, loudly, whether the data you received is exactly the data that was documented.

Single file. Zero dependencies. Python 3.8+. Fully offline — verification never phones home and requires nothing from the supplier.

Or skip the clone: pip install tgs-verify then tgs-verify <manifest.json>.

30-second demo

git clone https://github.com/thegray-systems/tgs-verify && cd tgs-verify
python3 tgs_verify.py examples/manifest.json
tgs-verify 1.0.0 — 3 asset(s), root: examples
  ✓ assets/scene_0001.png  c0c4002a61f8…
  ✓ assets/scene_0002.png  87226cc1ea67…
  ✓ assets/scene_0003.png  be0eb7f19036…
✓ VERIFIED — 3/3 assets match their custody record

Now watch it catch tampering — one pixel changed in one asset:

python3 tgs_verify.py examples/manifest.json --root examples/tampered
  ✓ assets/scene_0001.png  …
  ✗ ALTERED   assets/scene_0002.png
      expected 87226cc1…
      actual   a41647e1…
  ✓ assets/scene_0003.png  …
✗ FAILED — 2/3 assets match their custody record

Usage

python3 tgs_verify.py <manifest.json> [--root DIR]     # verify a JSON custody manifest
python3 tgs_verify.py --csv PN-123_manifest.csv --root ./delivery   # verify a delivery CSV
python3 tgs_verify.py manifest.json --json             # machine-readable report

Exit codes: 0 verified · 1 failed · 2 manifest unreadable. Wire it into CI and a bad delivery fails your pipeline before it touches training.

What a custody manifest records

Every asset in a TGS delivery carries: a SHA-256 fingerprint of the exact delivered bytes, a declared origin (synthetic / recorded / collected), for synthetic assets the generator model, version, and the license it was operated under, optional generation parameters, and the license class the data ships under (evaluation-only, non-exclusive, training-only, exclusive, full-ip-buyout, custom). The full format is defined in SPEC.md.

The verifier checks the certificate, not the factory: it proves delivery integrity and documented provenance without exposing anything about how data is produced.

Why this exists

Training-data provenance fails quietly. A dataset changes hands, a file gets re-encoded, a folder gets "helpfully" cleaned up — and the record no longer matches reality, which surfaces months later in diligence, an audit, or a lawsuit. A custody manifest plus an open verifier makes the failure loud and immediate instead: anyone in the chain — buyer, counsel, auditor, acquirer — can re-check the delivery in seconds, forever, without trusting the supplier's word.

Roadmap

  • v1.2 — Ed25519 manifest signatures (tamper-evident, attributable manifests) per SPEC §5.
  • v1.1project.produced_by (renamed from project.supplier, which remains a deprecated alias); project block now validated; two new origin values — authored, derived (with required derived_from).
  • v1.0license.class expanded to six classes — evaluation-only, non-exclusive, training-only, exclusive, full-ip-buyout, custom — aligned with the TGS delivery system.

License

MIT. The manifest format (SPEC.md) is open for anyone to implement — verifiers, generators, or both.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tgs_verify-1.1.0.tar.gz (7.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tgs_verify-1.1.0-py3-none-any.whl (7.9 kB view details)

Uploaded Python 3

File details

Details for the file tgs_verify-1.1.0.tar.gz.

File metadata

  • Download URL: tgs_verify-1.1.0.tar.gz
  • Upload date:
  • Size: 7.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for tgs_verify-1.1.0.tar.gz
Algorithm Hash digest
SHA256 acf3b07d2293e58596b45a2bf8d442aa5d970959d73ab5c27f155be8cdfc4d57
MD5 4eb56c05ed41ff3811a9def2754f15b6
BLAKE2b-256 19f0e3ea448684999c5281c8b1e4818348e601fec640038bc27bddc48a9fb06c

See more details on using hashes here.

Provenance

The following attestation bundles were made for tgs_verify-1.1.0.tar.gz:

Publisher: release.yml on TheGray-Systems/tgs-verify

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tgs_verify-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: tgs_verify-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 7.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for tgs_verify-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 788861db054563d860e25d2bb3b9e5135d94e0c30dca7374ed53912cc2e06a13
MD5 f61dac83f9bd8b2141db59c76acb9fd5
BLAKE2b-256 e0cba9d6ab8ef51a6126e884b375ad2bd0f49f1565f57ae7d0282967adf568f8

See more details on using hashes here.

Provenance

The following attestation bundles were made for tgs_verify-1.1.0-py3-none-any.whl:

Publisher: release.yml on TheGray-Systems/tgs-verify

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page