Skip to main content

Python library to analyse thread utilisation for dbt runs.

Project description

dbt Run Analyser

Coverage Badge

This package can help you analyse your dbt runs, and help you ensure you're using your threads most optimal.

Installation

pip install dbt-run-analyser

Example

See a set of examples in the plot.ipynb file.

Using the CLI

The dbt-run-analyser CLI allows you to analyze your dbt run logs and manifest files to gain insights into your dbt runs. Here is a basic example of how to use the CLI:

  1. Plot Run Times: To plot the run times of your dbt models, use the following command:

    dbt-run-analyser plot-run-times "path/to/manifest.json" "path/to/dbt_run.log"
    
  2. Plot Critical Path: Show the critical path through the run:

    dbt-run-analyser plot-critical-path "path/to/manifest.json" "path/to/dbt_run.log" --model "order_wide"
    

Replace "path/to/manifest.json" and "path/to/dbt_run.log" with the actual paths to your dbt manifest file and run log file, respectively.

Functionalities to come

  • cli interface.
  • Improvements/decrease in run time if threads are added or removed.
  • Identification of bottlenecks.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_run_analyser-0.3.0.tar.gz (14.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_run_analyser-0.3.0-py3-none-any.whl (12.5 kB view details)

Uploaded Python 3

File details

Details for the file dbt_run_analyser-0.3.0.tar.gz.

File metadata

  • Download URL: dbt_run_analyser-0.3.0.tar.gz
  • Upload date:
  • Size: 14.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.10

File hashes

Hashes for dbt_run_analyser-0.3.0.tar.gz
Algorithm Hash digest
SHA256 17290431b3e8a1143ebc3b10f923b999183f4fc11f10720a1238deeaf2a26d0f
MD5 33e35a7b78b5dd1bbf720b7dab273bed
BLAKE2b-256 3fa1398a83b06c6b7d4b327fde15c75e3affeb4838cbd6dc4c05b5b1ab073d76

See more details on using hashes here.

File details

Details for the file dbt_run_analyser-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_run_analyser-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 616c62548c1c670f49a9de69dc45c0961d10c77a01988f8b3827a4ecb21a0a9c
MD5 0468a80a7b3a6b303d20b7d830924c0d
BLAKE2b-256 d21ac648ef51330b495c4fc3e9585eccd7014967340608269d9f6563c2df2e12

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page