Skip to main content
Open Lakehouse Contract

Open Lakehouse Contract

The open standard for portable, executable lakehouse data contracts.

Documentation · Quickstart · Contract reference · Compatibility evidence

Define a data product's sources, schema, ownership, quality rules, PII handling, lineage, service levels (SLAs and SLOs), transformations and materialisation in one portable, vendor-neutral contract.

Open Lakehouse Contract (OLC) captures that definition in a portable YAML document.

The contract declares the intent. Any tool can validate its structure with JSON Schema, and a conforming runtime such as LakeLogic Core can execute that intent.

Validate a contract in 60 seconds

version: 1.0.0
info:
  title: Orders
  table_name: orders
model:
  fields:
    - name: order_id
      type: integer
      required: true
quality:
  row_rules:
    - name: positive_order_id
      sql: "order_id > 0"

Clone the repository, install the CLI and validate the example:

git clone https://github.com/LakeLogic/open-lakehouse-contract.git
cd open-lakehouse-contract
python -m pip install -e .
olc validate examples/orders.olc.yaml

The validator uses the published JSON Schema. It does not require a data engine or LakeLogic Core.

What OLC gives you

  • Earlier feedback. Reject invalid contracts in CI before a pipeline change reaches production.
  • Clear accountability. Record who owns the data product and the downstream consumers that depend on it.
  • Consistent governance. Keep schema, quality, PII handling, lineage and service-level expectations in one reviewable artifact.
  • Executable intent. Let a conforming runtime validate, quarantine, transform and materialise data from the declaration.
  • Portable definitions. Keep business intent separate from backend-owned engine, catalogue, storage and table-format settings.
  • Safer automation. Give humans and AI agents a typed contract they can validate before proposing or applying changes.

Execute with LakeLogic Core

OLC is the standard. LakeLogic Core is the open-source reference runtime.

python -m pip install lakelogic
from lakelogic import DataProcessor

processor = DataProcessor("orders.olc.yaml", engine="duckdb", strict=True)
accepted, quarantined = processor.run(source_df)

You can use the OLC schema without LakeLogic Core, and another runtime may implement the same specification.

Contract coverage

Concern Examples
Sources and ingestion Primary source, linked sources, load mode, watermark and post-ingestion lifecycle
Identity and ownership Product metadata, accountable owner and downstream consumer ownership
Schema and keys Fields, types, required values, primary keys and natural keys
Quality Row rules, dataset rules, uniqueness and null thresholds
Transformation SQL and typed transformation operations
Governance PII classification, masking, compliance metadata and quarantine
Service levels Freshness, availability and volume SLOs; downstream SLA expectations
Operations Lineage, notifications and run controls
Materialisation and delivery Write strategy, table format, target location and downstream consumers

See the field reference for the complete vocabulary.

Compatibility and evidence

OLC separates portable contract intent from runtime and platform configuration. Support is demonstrated at different levels:

  • Structural conformance proves a contract matches the public schema.
  • Runtime conformance compares observable behaviour across supported engines.
  • Provider evidence records what was deployed and materialised on each platform.

DuckDB and Polars run in the default executable-conformance suite. Other engines and platforms have their own stated scope and limitations. See the conformance suite and provider evidence matrix rather than assuming every engine × format × platform combination has identical coverage.

Documentation

  • Getting started — validate and execute your first contract.
  • What is OLC? — understand the contract/runtime boundary.
  • Contract reference — define sources, ownership, quality, transformation, lineage, service levels and materialisation.
  • Conformance — see how structural and runtime behaviour are tested.
  • Providers — inspect evidence and limitations by platform.
  • OLC and ODCS — understand how the standards complement each other.

Contributions are welcome. Start with the contributing guide.

Licence

Apache License 2.0. See LICENSE.

Release files for open-lakehouse-contract 0.8.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for open-lakehouse-contract 0.8.0
File Size Uploaded
open_lakehouse_contract-0.8.0.tar.gz 81.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for open-lakehouse-contract 0.8.0
File Interpreter ABI Platform
open_lakehouse_contract-0.8.0-py3-none-any.whl Python 3 none any Details

Total release size: 166.4 kB

Release files / open_lakehouse_contract-0.8.0.tar.gz

Download URL open_lakehouse_contract-0.8.0.tar.gz
Size 81.4 kB
Tags Source
SHA-256 checksum
How to use checksums
c9c2282a7e6d8fafc371877779c8e4883baa423251850fa2acbd87e5ff00c196
BLAKE2b-256 checksum
How to use checksums
bc4f4eef0f62d41d717127bcf24aeb62916a00381f97ca22b8f43ffe873d3eed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.12.9 {"installer":{"name":"uv","version":"0.12.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / open_lakehouse_contract-0.8.0-py3-none-any.whl

Download URL open_lakehouse_contract-0.8.0-py3-none-any.whl
Size 85.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
36cf151e84a2139390bf4413073f5f79ae4265d983479d0474ac782af56874c1
BLAKE2b-256 checksum
How to use checksums
aa8ddfe36cff2bd495d3a81347cc15e0321cfadbc9737a5847ccb36d52e0166a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.12.9 {"installer":{"name":"uv","version":"0.12.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

0.14.0

2 release files

0.12.0

2 release files

0.9.0

2 release files

This release

0.8.0 This release

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.4.0

2 release files

0.3.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page