Skip to main content

Data Engineering Toolkit compiler

The det CLI turns the controlled V3.2.0 official-ODCS Excel superset into canonical ODCS, DET execution metadata, and a readable dbt project. It includes safe questionnaire-based workbook creation, ODCS/DDL/dbt-to-Excel import and merge-safe synchronization, source-schema import, cross-sheet semantic/type validation, atomic post-sync generation, Data Contract synchronization, SQLFluff, and the isolated det prove acceptance flow. Data Contract CLI, dbt Core, DuckDB, and SQLFluff are default dependencies.

V3.2.0 makes the visible official Quality sheet authoritative, preserves advanced per-rule ODCS values, supports eight production warehouse providers, and adds mandatory 85.01% Python statement coverage. The generated dbt package has 98.53% DuckDB-scoped macro implementation coverage plus 100% public-API direct execution coverage and supports dbt Core plus Fusion-compatible projects. External resources are isolated behind brokers; reusable services interpret workbooks and input formats; independent components validate with stable diagnostic codes; and one emitter owns each artifact family. The CLI remains a thin exposer over ToolkitApplication.

Install

python -m pip install dbt-data-engineering-toolkit-compiler==3.2.0

The default installation includes Data Contract CLI, dbt Core, dbt-duckdb, DuckDB, and SQLFluff. Install one additional warehouse adapter per deployment environment, for example:

python -m pip install "dbt-data-engineering-toolkit-compiler[snowflake]"

Supported extras are athena, bigquery, clickhouse, databricks, duckdb, postgres, redshift, snowflake, and spark.

Safe first workbook

det workbook build data_product.xlsx --no-input
det validate data_product.xlsx

The default is blank: it does not add Customer 360 sample data. Use --sample-customer-data only when you explicitly want the demonstration.

Continue with det --help and det workbook --help. The source repository's root README contains the complete workbook-to-ODCS-to-dbt walkthrough, architecture, compatibility matrix, testing definitions, and deployment guide.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_data_engineering_toolkit_compiler-3.2.0.tar.gz (267.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file dbt_data_engineering_toolkit_compiler-3.2.0.tar.gz.

File metadata

File hashes

Hashes for dbt_data_engineering_toolkit_compiler-3.2.0.tar.gz
Algorithm Hash digest
SHA256 caff849dabb18d6c8c786f91c02142f1648362440da6c99c73ab35005d56bfdd
MD5 3f23a75357da4b22dfa7252a5229949a
BLAKE2b-256 7254e1e1fc9700131eff804c90285a29cedb0e34c11de0d6842edc24fdd75d65

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_data_engineering_toolkit_compiler-3.2.0.tar.gz:

Publisher: release.yml on systemizing-solutions/dbt_data_engineering_toolkit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dbt_data_engineering_toolkit_compiler-3.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_data_engineering_toolkit_compiler-3.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0eb9927aefb9743fe6726a38de5d4b2806144860a9dad41470235c0e0b8d8161
MD5 689eb0d20184a9621cbf85e1f38895d0
BLAKE2b-256 d9f2d891fdf65c9de1dd8102afdca917700a04ec9cf354474f33ff8529ace6c8

See more details on using hashes here.

Provenance

The following attestation bundles were made for dbt_data_engineering_toolkit_compiler-3.2.0-py3-none-any.whl:

Publisher: release.yml on systemizing-solutions/dbt_data_engineering_toolkit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

4.0.3

2 files

4.0.2

2 files

4.0.1

2 files

4.0.0

2 files

This release

3.2.0 This release

2 files

3.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page