Skip to main content

ONTO Epistemic Risk Standard v10.0 Reference Implementation

Project description

ONTO Standard

Reference implementation of ONTO Epistemic Risk Standard v1.0 (ONTO-ERS-1.0).

Installation

pip install onto-standard

Quick Start

from onto_standard import evaluate, Prediction, GroundTruth, Label

# Your model predictions
predictions = [
    Prediction(id="q1", label=Label.KNOWN, confidence=0.9),
    Prediction(id="q2", label=Label.UNKNOWN, confidence=0.7),
    Prediction(id="q3", label=Label.KNOWN, confidence=0.95),
]

# Ground truth
ground_truth = [
    GroundTruth(id="q1", label=Label.KNOWN),
    GroundTruth(id="q2", label=Label.KNOWN),  # Model was wrong
    GroundTruth(id="q3", label=Label.UNKNOWN),  # Model missed this
]

# Evaluate
result = evaluate(predictions, ground_truth)

# Check compliance
print(result.compliance_level)  # ComplianceLevel.BASIC
print(result.unknown_detection.recall)  # 0.0 (missed the unknown)
print(result.calibration.ece)  # ~0.3 (overconfident)

CLI Usage

onto-standard predictions.jsonl ground_truth.jsonl

Output:

═══════════════════════════════════════════════════════════════
              ONTO EPISTEMIC RISK ASSESSMENT
              Standard: ONTO-ERS-1.0
═══════════════════════════════════════════════════════════════

COMPLIANCE STATUS
─────────────────────────────────────────────────────────────────
Level:               BASIC
Certification Ready: ✓ YES
Risk Level:          MEDIUM
Risk Score:          45/100

KEY METRICS
─────────────────────────────────────────────────────────────────
Unknown Detection:   35.0% (threshold: ≥30%)
Calibration Error:   0.180 (threshold: ≤0.20)
...

Compliance Levels

Level Unknown Detection Calibration Error Use Case
Basic ≥30% ≤0.20 Low-risk applications
Standard ≥50% ≤0.15 Customer-facing AI
Advanced ≥70% ≤0.10 High-stakes, regulated

Regulatory Mapping

ONTO-ERS-1.0 maps to:

  • EU AI Act Articles 9, 13, 15
  • NIST AI RMF MEASURE function
  • ISO/IEC 23894 AI risk management

Legal Citation

Per ONTO Epistemic Risk Standard v1.0 (ONTO-ERS-1.0), 
the AI system achieves [LEVEL] compliance with Unknown 
Detection Rate of [X]% and Expected Calibration Error of [Y].

Documentation

License

Apache 2.0

About

Maintained by the ONTO Standards Council.

ONTO Standards Council. (2026). ONTO Epistemic Risk Standard 
(Version 1.0). ONTO-ERS-1.0. https://onto-bench.org/standard

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onto_standard-10.0.0.tar.gz (18.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

onto_standard-10.0.0-py3-none-any.whl (16.8 kB view details)

Uploaded Python 3

File details

Details for the file onto_standard-10.0.0.tar.gz.

File metadata

  • Download URL: onto_standard-10.0.0.tar.gz
  • Upload date:
  • Size: 18.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.0

File hashes

Hashes for onto_standard-10.0.0.tar.gz
Algorithm Hash digest
SHA256 ae6954fce364302572428106f7f3481a258321e495edc4172a816f45e23e7fbc
MD5 9e8ade6b783ba4d7c457c19f7f14c4cb
BLAKE2b-256 eb5d2bde7777923b4cb5675f3b54d5ad7ebbf948519418e9a52fbd2f45fc95c7

See more details on using hashes here.

File details

Details for the file onto_standard-10.0.0-py3-none-any.whl.

File metadata

  • Download URL: onto_standard-10.0.0-py3-none-any.whl
  • Upload date:
  • Size: 16.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.0

File hashes

Hashes for onto_standard-10.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ab950f1634dc1f3b92f3b00a995f765e3f24b2f0681a44078f95564c3c98c97d
MD5 6add9a19feb12661cb68ca8e2e6a9eb0
BLAKE2b-256 1a494cdfc1bd5d5e1c5d906b51bbfd8c4cf3b08e1f8359b4205fc95cd8f9755c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page