A package for computing coverage of dbt-managed data warehouses
Project description
dbt-coverage
A CLI library with Python backend for computing docs and test coverage of dbt managed data warehouses.
Installation
pip install dbt-coverage
Usage
dbt-coverage
comes with two basic commands: compute
and compare
. The
documentation for the individual commands can be shown by using the --help
option.
Compute
Compute coverage from target/catalog.json
and target/manifest.json
files
found in a dbt project, e.g.
jaffle_shop. You need to select
documentation or test coverage by using the respective CLI argument.
$ cd jaffle_shop
$ dbt run # Materialize models
$ dbt docs generate # Generate catalog.json and manifest.json
$ dbt-coverage compute doc --cov-report coverage-doc.json # Compute doc coverage, print it and write it to coverage-doc.json file
Coverage report
=====================================================================
customers 6/7 85.7%
orders 9/9 100.0%
raw_customers 0/3 0.0%
raw_orders 0/4 0.0%
raw_payments 0/4 0.0%
stg_customers 0/3 0.0%
stg_orders 0/4 0.0%
stg_payments 0/4 0.0%
=====================================================================
Total 15/38 39.5%
$ dbt-coverage compute test --cov-report coverage-test.json # Compute test coverage, print it and write it to coverage-test.json file
Coverage report
=====================================================================
customers 1/7 14.3%
orders 8/9 88.9%
raw_customers 0/3 0.0%
raw_orders 0/4 0.0%
raw_payments 0/4 0.0%
stg_customers 1/3 33.3%
stg_orders 2/4 50.0%
stg_payments 2/4 50.0%
=====================================================================
Total 14/38 36.8%
Compare
Compare two coverage.json
files generated by the compute
command. This is
useful to ensure that the coverage does not drop while making changes to the
project.
$ dbt-coverage compare coverage-after.json coverage-before.json
# Coverage delta summary
before after +/-
=============================================
Coverage 39.47% 38.46% -1.01%
=============================================
Tables 8 8 +0/+0
Columns 38 39 +1/+0
=============================================
Hits 15 15 +0/+0
Misses 23 24 +1/+0
=============================================
# New misses
==============================================================
Catalog 15/38 (39.47%) -> 15/39 (38.46%)
==============================================================
- customers 6/7 (85.71%) -> 6/8 (75.00%)
-- new_col -/- (-) -> 0/1 (0.00%)
==============================================================
Combined use-case
$ cd my-dbt-project
$ dbt run # Materialize models
$ dbt docs generate # Generate catalog.json and manifest.json
$ dbt-coverage compute doc --cov-report before.json --cov-fail-under 0.5 # Fail if coverage is lower than 50%
# Make changes to the dbt project, e.g. add some columns to the DWH, document some columns, etc.
$ dbt run # Materialize the changed models
$ dbt docs generate # Generate catalog.json and manifest.json
$ dbt-coverage compute doc --cov-report after.json --cov-fail-compare before.json # Fail if the current coverage is lower than coverage in before.json
$ dbt-coverage compare after.json before.json # Generate a detailed coverage delta report
Related packaged
https://github.com/mikaelene/dbt-test-coverage
License
Licensed under the MIT license (see LICENSE.md file for more details).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for dbt_coverage-0.1.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c9a723aceb8750d68c0b8eb36a719ab696fdf28677503f5db0eccf9b461989da |
|
MD5 | eae529ee94a3d7a96abd95aba0be95bc |
|
BLAKE2b-256 | d4691f999667666a76bcaa5f871e49a992b1f63b4537d9b8e28d0aacbc8870e3 |