Skip to main content

Open Model Integration Validator (OMIV)

OMIV is an offline-first evidence and verification framework for AI artifacts, transformations, deployments, and runtime identity.

CI Python 3.11+ License: Apache-2.0 Status: public preview

It preserves the difference between what was declared, what was observed, what was cryptographically verified, what policy permits, and what remains unavailable. OMIV is a pre-1.0 framework, not a certification authority, safety evaluator, authenticity oracle, or production-ready compliance product.

Why OMIV

A model name is not a model identity. A signature does not prove runtime-loaded weights. A deployment declaration does not prove which weights produced an output. Missing evidence remains unavailable. Canonical validity is not authenticity, and structural parity is not behavioral equivalence.

OMIV gives developers strict schemas, canonical identities and digests, scope-qualified verification, signatures, policy results, and portable evidence. It does not turn those records into claims about model safety, provider authority, complete behavioral equivalence, or runtime weight attribution.

What OMIV verifies

Evidence surface OMIV can verify OMIV does not establish
Local artifacts Declared byte identity, manifests, structure, and canonical digests Safety, authenticity, or publisher authority
Transformations Supplied lineage, mappings, quantization representation, and bounded numerical evidence Complete semantic or behavioral equivalence
Trust and policy Signature validity, stated authority, policy evaluation, custody, and historical linkage That a signer is the rightful publisher or a policy is appropriate
Deployment and runtime Supplied declarations, observations, bindings, and output-provenance records Which weights actively produced an output without adequate evidence
Remote metadata Bounded supplied snapshots and shard reconciliation Current provider state or payload identity by default

An absent, unsupported, or unchecked evidence item never becomes PASS.

30-second quickstart

From a clean clone, install OMIV from source. Dependency installation may contact a package index; the verification command itself is offline.

python -m venv .venv
source .venv/bin/activate
python -m pip install -e .
omiv --version
omiv runtime-resolution verify runtime-resolution-parity/scenarios/immutable-pinned.json

Expected verification output and exit status:

0.10.0
VALID_CANONICAL_RUNTIME_RESOLUTION_OBJECT schema=omiv.runtime-resolution-scenario-result.v1
exit code: 0

The tracked input is synthetic demonstration data. This command establishes only strict parsing, supported-schema recognition, and canonical identity/digest relationships for that supplied object. It makes no provider request, resolves no live alias, observes no deployment or runtime-loaded weights, and runs no inference. It does not establish provider authenticity, publisher authority, safety, or production readiness. See the complete quickstart and offline demonstration, including PowerShell activation and exit-code semantics.

Evidence chain

flowchart TD
    A[Source / registry / publisher] --> B[Resolution and acquisition evidence]
    B --> C[Exact artifact identity]
    C --> D[Payload manifest and shard reconciliation]
    D --> E[Transformation, quantization, tokenizer evidence]
    E --> F[Signature, authority, and policy]
    F --> G[Deployment and runtime binding]
    G --> H[Output provenance and historical audit]
    A -. declaration is not observation .-> B
    C -. artifact identity is not runtime identity .-> G
    F -. signature validity is not publisher authority .-> A
    E -. finite probes are not behavioral equivalence .-> H
    B -. absent evidence is not PASS .-> H

The arrows describe possible evidence flow, not universal automation. Read the architecture overview for component boundaries and the current Phase 5/6 evidence model.

Current capabilities

Area Available now Bounded, local, or offline scope Explicit non-goals
Phase 5 Passports, custody, attestations, trust, governance, security, runtime continuity, and historical audit Verification of supplied evidence and policy-scoped results Safety certification, real-world truth, or automatic approval
Phase 6A Payload manifests and exact local byte identity Local files and declared expectation scope Publisher identity or safety
Phase 6B Remote metadata and shard reconciliation Supplied/pinned metadata; collectors are separate and opt-in Payload download or inferred weight identity
Phase 6C Quantization representation and bounded numerical-fidelity evidence Declared samples, limits, and Decimal semantics Whole-model behavioral equivalence
Phase 6D Tokenizer/configuration structural parity and supplied probes Supplied local artifacts and finite probes Complete tokenizer or behavioral equivalence
Phase 6E Mutable resolution, deployment binding, supplied backend results, and output-provenance schemas Offline verification of supplied records Live resolution, inference, or provable inference

The documentation index links the design and implementation documents for every released engineering phase. Phase 6F Assurance Bundle interoperability is planned and is not implemented.

How to read an OMIV result

OMIV results are deliberately narrower than labels such as “verified model.” Read each result through five questions:

  1. What is the subject? A file, logical model, transformation, deployment, runtime observation, request, and output are different subjects.
  2. What is the scope? A selected member set, local directory, finite probe set, policy profile, environment, and historical cutoff limit what was evaluated.
  3. What evidence was supplied? A declaration, direct observation, digest-only reference, signature, and provider document carry different authority.
  4. What was reconstructed? Schema validity, canonical digest identity, reference linkage, signature validity, and policy evaluation are separate checks.
  5. What remains unavailable? Limitations and missing evidence are part of the result, not footnotes to discard.

For example, an intact signature can show that bytes were signed by a particular key. A separate trust record is needed to state what that key is authorized to sign, and neither record alone shows that the signed artifact was loaded by a runtime. Likewise, an exact finite probe result applies only to the declared probes and does not establish identical weights or behavior outside that set.

Evidence result vocabulary

Different OMIV subsystems use typed, domain-specific outcomes, but the following reading rules are consistent:

Result shape Interpretation
Valid canonical object Strict parsing and identity reconstruction succeeded for the supplied object
Exact match for declared scope All requirements inside an explicit finite scope matched
Valid with limitations Integrity succeeded while named evidence or scope remains incomplete
Not available / not checked Required evidence was not supplied or was intentionally outside the operation
Policy nonpassing The supplied evidence did not satisfy the selected policy; this is not necessarily malformed input
Integrity invalid Schema, digest, reference, signature, or canonical reconstruction failed

Always keep the subject, scope, evidence source, policy identity, and limitations beside the headline outcome. Portable evidence is designed to preserve those qualifiers when it moves between tools or organizations.

Verification posture

OMIV defaults to offline verification. Network-capable collection is a separate, explicit operation with its own bounds; verification never fills gaps by contacting a provider. Canonical output avoids host-specific paths, clock-dependent identities, and accidental mutation of tracked evidence.

This posture makes results reviewable in a clean checkout and usable in air-gapped or controlled environments after installation. It also keeps collection authority separate from verification authority: the verifier can check a portable supplied record without claiming to have witnessed how it was collected.

When integrating OMIV into automation, treat nonzero scope/policy outcomes, integrity errors, missing external artifacts, and unsupported evidence as distinct states. Do not flatten them into a generic success or failure that loses why the result was bounded.

Common offline workflows

The root quickstart exercises one safe verification path. The offline evidence walkthrough continues through tracked Phase 5 and Phase 6A–6E evidence, including expected semantic exit-1 results and a temporary malformed-input exit-2 demonstration. The repository also contains bounded offline interfaces for:

  • validating canonical inventory structure;
  • comparing GGUF inventories under explicit policies;
  • validating semantic mappings and transformation lineage;
  • verifying Model Passport and custody integrity;
  • checking signed attestations, trust bundles, and revocation records;
  • evaluating governance, security, and historical trust evidence;
  • verifying local payload manifests and declared expectations;
  • reconstructing remote metadata and shard-reconciliation objects;
  • inspecting quantization and tokenizer/configuration evidence;
  • verifying supplied deployment, runtime, and output-provenance records.

These commands do not all have the same exit-code policy. Consult the linked phase document and command help before automating a gate:

omiv --help
omiv runtime-resolution verify --help

Collectors and conversion runners are distinct from offline verification. Some are explicitly opt-in or can execute external tools; they are not part of the quickstart and should be reviewed under their own documented threat and resource boundaries.

Repository evidence versus external artifacts

Tracked synthetic and canonical examples make verifier behavior reviewable without large payloads. They do not pretend to be fresh provider observations. When a referenced external artifact is absent, OMIV either reports that absence or offers a clearly named reduced-scope verification mode where the schema supports one.

In particular, the ignored Kimi raw inventory is not a quickstart dependency. Do not create or download it to run the demonstration. Remote practice collectors are also unnecessary for normal offline verification and are never invoked implicitly.

Practice-profile limitations

Practice profiles illustrate bounded evidence contracts; they are not endorsements, partnerships, or claims about current provider state.

Profile Current scope Important limitation
Qwen Existing local model-pack and format examples Example coverage does not make a universal integration claim
Kimi Structural and reference evidence The large raw local inventory is not distributed
xAI Bounded public metadata and documented mutable-alias/roadmap evidence No observed runtime weight identity
DeepSeek Readiness and missing-snapshot contract Readiness is not a completed integration
Hugging Face Provider-neutral bounded metadata interface No default network use and no provider endorsement

Public and future commercial boundary

The open core owns canonical schemas, canonicalization, evidence semantics, signatures and verification, the offline CLI, portable evidence, policy-result semantics, and future public Assurance Bundle verification.

Possible future commercial operation may add managed collection, private registries, continuous monitoring, organization-wide policy operation, RBAC/SSO, KMS/HSM integration, deployment admission, managed history, connectors, and support. No such product or repository is claimed here, and it may not secretly redefine canonical public OMIV semantics. Read the full boundary.

Documentation

Start with the documentation index:

Project status and roadmap

OMIV is public and publicly available as a pre-1.0 Alpha public preview. The repository is public; the current public main contains the audited 0.10.0 release candidate, but no v0.10.0 tag, GitHub Release, or PyPI publication exists yet. Engineering Phases 5 and 6A–6E are released in repository history; Phase 6F is planned and not implemented. Public availability is not release completion and does not establish production readiness, certification, safety, provider authenticity, or publisher authority. See the Live GitHub visibility is authoritative. See the roadmap, release notes, and changelog.

Contributing, security, support, and license

Contributions follow CONTRIBUTING.md and GOVERNANCE.md. Report vulnerabilities through SECURITY.md, and use SUPPORT.md for support scope.

OMIV is licensed under Apache-2.0; see NOTICE and third-party notices. Project and provider names remain subject to trademark guidance. OMIV is independent and is not an official, approved, endorsed, or affiliated tool of any model provider.

Metadata

Release files for open-model-integration-validator 0.10.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for open-model-integration-validator 0.10.0
File Size Uploaded
open_model_integration_validator-0.10.0.tar.gz 713.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for open-model-integration-validator 0.10.0
File Interpreter ABI Platform
open_model_integration_validator-0.10.0-py3-none-any.whl Python 3 none any Details

Total release size: 1.4 MB

Release files / open_model_integration_validator-0.10.0.tar.gz

Download URL open_model_integration_validator-0.10.0.tar.gz
Size 713.9 kB
Tags Source
SHA-256 checksum
How to use checksums
a659d14f36dfa61bd2170ac84685312ceefb27f7e60e3f80ef8c84344c7eb640
BLAKE2b-256 checksum
How to use checksums
81ad42145a9b815e966cd078a0428c52d66874bf5f83fb8b8f39a7993e45cd25
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 12, 2026.

Transparency log

Release files / open_model_integration_validator-0.10.0-py3-none-any.whl

Download URL open_model_integration_validator-0.10.0-py3-none-any.whl
Size 728.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
caa4040175105fc65be3206ceff16e5916258c113de28af5b0242361aa3dc277
BLAKE2b-256 checksum
How to use checksums
ef1d506fdb82729b3254bc12f60303df32470f2ff94a8669f291109e12938349
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 12, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

0.10.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page