ONTO — Epistemic Risk Measurement and Grounding for AI Systems. Deterministic scoring (REP, EpCE, DLA), EM1-EM5 taxonomy, Ed25519 proof chain, GOLD v4.5 calibration. pip install onto-standard.
Project description
ONTO Standard
Epistemic Risk Measurement and Grounding for AI Systems.
ONTO measures the gap between what AI claims to know and what it actually knows. Three deterministic metrics — REP (Response Epistemic Profile), EpCE (Epistemic Calibration Error), DLA (Dual-Layer Agreement) — scored against the EM1–EM5 epistemic marker taxonomy (92 patterns). Every evaluation signed with Ed25519 (104-byte proof chain).
Validated on 10 major AI systems. Mean risk score: 0.55 (Grade D). 9 of 10 hallucinated on verifiable questions. Full data →
Installation
pip install onto-standard
Quick Start
from onto_standard import evaluate, Prediction, GroundTruth, Label
predictions = [
Prediction(id="q1", label=Label.KNOWN, confidence=0.92),
Prediction(id="q2", label=Label.UNKNOWN, confidence=0.15),
Prediction(id="q3", label=Label.KNOWN, confidence=0.78),
Prediction(id="q4", label=Label.UNKNOWN, confidence=0.45),
]
ground_truth = [
GroundTruth(id="q1", label=Label.KNOWN),
GroundTruth(id="q2", label=Label.UNKNOWN),
GroundTruth(id="q3", label=Label.KNOWN),
GroundTruth(id="q4", label=Label.UNKNOWN),
]
result = evaluate(predictions, ground_truth)
print(result.compliance_level) # ComplianceLevel.STANDARD
print(result.risk_score) # 18
print(result.ece) # 0.1025
print(result.u_recall) # 1.0
print(result.certification_ready) # True
CLI
onto-standard predictions.jsonl ground_truth.jsonl
Compliance Levels
| Level | U-Recall | ECE | Use Case |
|---|---|---|---|
| Basic | ≥30% | ≤0.20 | Internal tools, prototypes |
| Standard | ≥50% | ≤0.15 | Customer-facing AI |
| Advanced | ≥70% | ≤0.10 | Regulated, high-stakes systems |
ONTO Proxy (GOLD Injection)
For production grounding, connect your AI through ONTO Proxy. One line change — your model gains measurable epistemic discipline:
# Before
client = OpenAI(api_key="sk-...")
# After — GOLD injected server-side
client = OpenAI(
api_key="onto_...",
base_url="https://api.ontostandard.org/v1/proxy/chat/completions"
)
GOLD never leaves the server. You get the effect, not the document.
| Tier | Price | Proxy Requests | GOLD Tier |
|---|---|---|---|
| Open | $0 | 500/day | TIER 2 (~17K tokens) |
| Standard | $30,000/yr ($2,500/mo) | 50,000/day | TIER 4 (~199K tokens) |
| Enterprise | $114,000/yr ($9,500/mo) | Unlimited | TIER 6 (~459K tokens) |
Regulatory Alignment
- EU AI Act — Articles 9, 13, 15, 43
- NIST AI RMF — MEASURE function
- ISO/IEC 42001 — Clauses 6, 8, 9
Links
- Standard: ontostandard.org
- Documentation: ontostandard.org/docs
- Portal: ontostandard.org/app
- Research Paper: ontostandard.org/paper
- Research Data: github.com/nickarstrong/onto-research
- API: api.ontostandard.org
License
Apache 2.0 (SDK). GOLD corpus under ONTO Gold Asymmetric AI License v5.1.
Citation
Lee, T. (2026). ONTO: A Formal Framework for Measuring Epistemic Risk
in Large Language Model Outputs. ONTO Standards Council.
https://ontostandard.org/paper/
© 2026 ONTO Standards Council
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file onto_standard-10.2.0.tar.gz.
File metadata
- Download URL: onto_standard-10.2.0.tar.gz
- Upload date:
- Size: 17.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ab47bd0d21fc1c254ef31b19f45bd748da620b603f624fce7684099c3252c58d
|
|
| MD5 |
b7af0accf6815c2f2af6b99d74569d0f
|
|
| BLAKE2b-256 |
07d1b967b20bbd75a234651cd1b5a1f43035d0df500f5d7f5001e3118de02407
|
File details
Details for the file onto_standard-10.2.0-py3-none-any.whl.
File metadata
- Download URL: onto_standard-10.2.0-py3-none-any.whl
- Upload date:
- Size: 11.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a4cc8366a7305aa94824a51db342d5503d1d74b360702474440b469a34e43ebf
|
|
| MD5 |
1206746f0326da629d6d3daa4fe50e97
|
|
| BLAKE2b-256 |
07ac71e7800997d51bfa78aa6e7a02531a34c939d0eba47c6972f5f7dd88de3c
|