Skip to main content

Data Engineering Toolkit compiler

The det CLI turns the controlled V4.0.1 official-ODCS Excel superset into canonical ODCS, DET execution metadata, and a readable dbt project. It includes safe questionnaire-based workbook creation, ODCS/DDL/dbt-to-Excel import and merge-safe synchronization, source-schema import, cross-sheet semantic/type validation, atomic post-sync generation, Data Contract synchronization, SQLFluff, and the isolated det prove acceptance flow. Data Contract CLI, dbt Core, DuckDB, and SQLFluff are default dependencies.

V4.0.1 makes the visible official Quality sheet authoritative, preserves advanced per-rule ODCS values, supports eight production warehouse providers, and adds mandatory 85.01% Python statement coverage. The generated dbt package has 98.53% DuckDB-scoped macro implementation coverage plus 100% public-API direct execution coverage and supports dbt Core plus Fusion-compatible projects. External resources are isolated behind brokers; reusable services interpret workbooks and input formats; independent components validate with stable diagnostic codes; and one emitter owns each artifact family. The CLI remains a thin exposer over ToolkitApplication.

Install

python -m pip install dbt-data-engineering-toolkit-compiler==4.0.1

The default installation includes Data Contract CLI, dbt Core, dbt-duckdb, DuckDB, and SQLFluff. Install one additional warehouse adapter per deployment environment, for example:

python -m pip install "dbt-data-engineering-toolkit-compiler[snowflake]"

Supported extras are athena, bigquery, clickhouse, databricks, duckdb, postgres, redshift, snowflake, and spark.

Safe first workbook

det workbook build data_product.xlsx --no-input
det validate data_product.xlsx

The default is blank: it does not add Customer 360 sample data. Use --sample-customer-data only when you explicitly want the demonstration.

Continue with det --help and det workbook --help. The source repository's root README contains the complete workbook-to-ODCS-to-dbt walkthrough, architecture, compatibility matrix, testing definitions, and deployment guide.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_data_engineering_toolkit_compiler-4.0.1.tar.gz (267.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file dbt_data_engineering_toolkit_compiler-4.0.1.tar.gz.

File metadata

File hashes

Hashes for dbt_data_engineering_toolkit_compiler-4.0.1.tar.gz
Algorithm Hash digest
SHA256 3a6f63c8bdfce6b1cc311231c6d3062b459538e2daef48a136338d37f2c2936d
MD5 86d20d2ad0af7141f706fd603dd0477e
BLAKE2b-256 e5fa4d5c7f434d6d745bc0d40bb96ade075e2735aeddadb5a99b316ad6aecf9e

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_data_engineering_toolkit_compiler-4.0.1.tar.gz:

Publisher: release.yml on systemizing-solutions/dbt_data_engineering_toolkit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dbt_data_engineering_toolkit_compiler-4.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_data_engineering_toolkit_compiler-4.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 300ac138bb0e1b19c3215a21c76f95a5298bc04896042233b737bf6f93144514
MD5 58a01d6983764165b361ae7b48501548
BLAKE2b-256 51128e6aeb6523e8b880ef52c2fdbc2800d3f68cd37184de67a46038f845e047

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_data_engineering_toolkit_compiler-4.0.1-py3-none-any.whl:

Publisher: release.yml on systemizing-solutions/dbt_data_engineering_toolkit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

4.0.3

2 files

4.0.2

2 files

This release

4.0.1 This release

2 files

4.0.0

2 files

3.2.0

2 files

3.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page