ONTO Epistemic Risk Standard v1.0 Reference Implementation
Project description
ONTO Standard
Reference implementation of ONTO Epistemic Risk Standard v1.0 (ONTO-ERS-1.0).
Installation
pip install onto-standard
Quick Start
from onto_standard import evaluate, Prediction, GroundTruth, Label
# Your model predictions
predictions = [
Prediction(id="q1", label=Label.KNOWN, confidence=0.9),
Prediction(id="q2", label=Label.UNKNOWN, confidence=0.7),
Prediction(id="q3", label=Label.KNOWN, confidence=0.95),
]
# Ground truth
ground_truth = [
GroundTruth(id="q1", label=Label.KNOWN),
GroundTruth(id="q2", label=Label.KNOWN), # Model was wrong
GroundTruth(id="q3", label=Label.UNKNOWN), # Model missed this
]
# Evaluate
result = evaluate(predictions, ground_truth)
# Check compliance
print(result.compliance_level) # ComplianceLevel.BASIC
print(result.unknown_detection.recall) # 0.0 (missed the unknown)
print(result.calibration.ece) # ~0.3 (overconfident)
CLI Usage
onto-standard predictions.jsonl ground_truth.jsonl
Output:
═══════════════════════════════════════════════════════════════
ONTO EPISTEMIC RISK ASSESSMENT
Standard: ONTO-ERS-1.0
═══════════════════════════════════════════════════════════════
COMPLIANCE STATUS
─────────────────────────────────────────────────────────────────
Level: BASIC
Certification Ready: ✓ YES
Risk Level: MEDIUM
Risk Score: 45/100
KEY METRICS
─────────────────────────────────────────────────────────────────
Unknown Detection: 35.0% (threshold: ≥30%)
Calibration Error: 0.180 (threshold: ≤0.20)
...
Compliance Levels
| Level | Unknown Detection | Calibration Error | Use Case |
|---|---|---|---|
| Basic | ≥30% | ≤0.20 | Low-risk applications |
| Standard | ≥50% | ≤0.15 | Customer-facing AI |
| Advanced | ≥70% | ≤0.10 | High-stakes, regulated |
Regulatory Mapping
ONTO-ERS-1.0 maps to:
- EU AI Act Articles 9, 13, 15
- NIST AI RMF MEASURE function
- ISO/IEC 23894 AI risk management
Legal Citation
Per ONTO Epistemic Risk Standard v1.0 (ONTO-ERS-1.0),
the AI system achieves [LEVEL] compliance with Unknown
Detection Rate of [X]% and Expected Calibration Error of [Y].
Documentation
- Standard: https://onto-bench.org/standard
- API Reference: https://onto-bench.org/standard/api
- Certification: https://onto-bench.org/certified
License
Apache 2.0
About
Maintained by the ONTO Standards Council.
ONTO Standards Council. (2026). ONTO Epistemic Risk Standard
(Version 1.0). ONTO-ERS-1.0. https://onto-bench.org/standard
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
onto_standard-1.0.0.tar.gz
(15.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file onto_standard-1.0.0.tar.gz.
File metadata
- Download URL: onto_standard-1.0.0.tar.gz
- Upload date:
- Size: 15.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
37130774c9aebefef04f9a94135e5d45f84b745c8dee724fd70c4cddd33bc0da
|
|
| MD5 |
ae4bee0f7ffa80fa040afbaff2894887
|
|
| BLAKE2b-256 |
61fb2d506191c0d35f79e221bdb33b437477764546165a0a442376c4039929c6
|
File details
Details for the file onto_standard-1.0.0-py3-none-any.whl.
File metadata
- Download URL: onto_standard-1.0.0-py3-none-any.whl
- Upload date:
- Size: 11.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9c6f1a9d02a3d4fb69632812dae77cfdd2b4418d7dd62d65c246a431d5b3667b
|
|
| MD5 |
e52bf4bd0582a6ddfb5967c697422c0f
|
|
| BLAKE2b-256 |
642c604cbd7e9e48bc293edffee10a4ffaf325c8ea8f91b1915027c6490e1add
|