Skip to main content

Data Engineering Toolkit compiler

The det CLI turns the controlled V4.0.0 official-ODCS Excel superset into canonical ODCS, DET execution metadata, and a readable dbt project. It includes safe questionnaire-based workbook creation, ODCS/DDL/dbt-to-Excel import and merge-safe synchronization, source-schema import, cross-sheet semantic/type validation, atomic post-sync generation, Data Contract synchronization, SQLFluff, and the isolated det prove acceptance flow. Data Contract CLI, dbt Core, DuckDB, and SQLFluff are default dependencies.

V4.0.0 makes the visible official Quality sheet authoritative, preserves advanced per-rule ODCS values, supports eight production warehouse providers, and adds mandatory 85.01% Python statement coverage. The generated dbt package has 98.53% DuckDB-scoped macro implementation coverage plus 100% public-API direct execution coverage and supports dbt Core plus Fusion-compatible projects. External resources are isolated behind brokers; reusable services interpret workbooks and input formats; independent components validate with stable diagnostic codes; and one emitter owns each artifact family. The CLI remains a thin exposer over ToolkitApplication.

Install

python -m pip install dbt-data-engineering-toolkit-compiler==4.0.0

The default installation includes Data Contract CLI, dbt Core, dbt-duckdb, DuckDB, and SQLFluff. Install one additional warehouse adapter per deployment environment, for example:

python -m pip install "dbt-data-engineering-toolkit-compiler[snowflake]"

Supported extras are athena, bigquery, clickhouse, databricks, duckdb, postgres, redshift, snowflake, and spark.

Safe first workbook

det workbook build data_product.xlsx --no-input
det validate data_product.xlsx

The default is blank: it does not add Customer 360 sample data. Use --sample-customer-data only when you explicitly want the demonstration.

Continue with det --help and det workbook --help. The source repository's root README contains the complete workbook-to-ODCS-to-dbt walkthrough, architecture, compatibility matrix, testing definitions, and deployment guide.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_data_engineering_toolkit_compiler-4.0.0.tar.gz (266.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file dbt_data_engineering_toolkit_compiler-4.0.0.tar.gz.

File metadata

File hashes

Hashes for dbt_data_engineering_toolkit_compiler-4.0.0.tar.gz
Algorithm Hash digest
SHA256 19596f3432b4d128340a85b40822b5e28a19c1df0abd552976e6b07f23b60c80
MD5 7750978f12615caf5546718e227363b8
BLAKE2b-256 5b8b50b29466cbb666e6415fc5301de0174695a001d9e384d1faa2a9d5eefcf8

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_data_engineering_toolkit_compiler-4.0.0.tar.gz:

Publisher: release.yml on systemizing-solutions/dbt_data_engineering_toolkit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dbt_data_engineering_toolkit_compiler-4.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_data_engineering_toolkit_compiler-4.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8f7da9e53b520836952b3ff45712fb3b11d326259724851767e5379d136e4d36
MD5 7961c821aafcdbe92562ee617ca19981
BLAKE2b-256 ce739ead39dc14e1c50e10104e3d59a1a0a7f0292e1bb1a5ff809c5f9eb0ac3c

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_data_engineering_toolkit_compiler-4.0.0-py3-none-any.whl:

Publisher: release.yml on systemizing-solutions/dbt_data_engineering_toolkit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

4.0.3

2 files

4.0.2

2 files

4.0.1

2 files

This release

4.0.0 This release

2 files

3.2.0

2 files

3.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page