lightrider-huggingface

Hugging Face datasets with a provable, reproducible origin.

Each dataset is generated from a seed drawn from a named quantum entropy source through Light Rider. The seed comes with a signed receipt. Anyone can check that receipt, confirm the seed came from that draw, and regenerate the dataset exactly.

Two kinds of dataset:

• Random quantum circuits, for example 500 circuits for benchmarking.
• Random evaluation subsets: N rows sampled from an existing Hugging Face dataset, pinned to an exact revision so the same rows can always be fetched again.

Install

pip install lightrider-huggingface

You need a Light Rider API key to create datasets (see entropy.lightriderinc.com/developers). Each dataset costs one draw, or 1 credit. Publishing needs a Hugging Face token with write access. Verifying needs neither.

export LR_API_KEY=lr_live_...
export HF_TOKEN=hf_...

Example

import lightrider_huggingface as lrhf

# 500 random circuits: 5 qubits, depth 10
ds = lrhf.circuits(500, num_qubits=5, depth=10, source="anu")

# Or 200 random rows from the GSM8K test split
# ds = lrhf.eval_subset("openai/gsm8k", "test", n=200, config="main", source="anu")

print(ds)                   # rows, source and request id
df = ds.to_pandas()

# Push to the Hub: data, dataset card and signed receipt. Private unless private=False.
lrhf.publish(ds, "your-username/random-circuits-5q")

Circuit rows have circuit_id, num_qubits, depth, gate counts, instructions (JSON) and qasm (OpenQASM 2.0). gate_set= picks the gates (default h, x, sx, rz, cx). Subset rows are the source rows unchanged, plus _lr_source_index. Pass fraction=0.1 in place of n= to sample a share of the split.

Verify a dataset

import lightrider_huggingface as lrhf

report = lrhf.verify("your-username/random-circuits-5q")
print(report)               # each check, PASS or FAIL
assert report.ok

No Light Rider key is needed. For a private dataset, set HF_TOKEN. For a subset of a very large dataset, verify(..., indices_only=True) skips re-downloading the source.

How verification works

1. The receipt is genuine. Light Rider signs every draw's receipt (Ed25519). Its public key is at entropy.lightriderinc.com/api/v1/public-key.
2. The seed is that draw's output. The signed receipt includes a hash of the exact bytes drawn, so a seed from any other draw doesn't match.
3. The data follows from the seed. Generation is deterministic and fully specified, so verify rebuilds the rows from the seed and compares them with the published ones.

Every published dataset includes its receipt and the full record (lightrider_provenance.json), so all of this can be checked independently.

What this doesn't claim: that quantum randomness is better than a good classical generator. It's an alternative source whose origin you can check. A receipt also can't show that the publisher drew only once; its timestamp shows when the draw happened.

License

Apache-2.0. Built by Light Rider.