Skip to main content

Python library to analyse thread utilisation for dbt runs.

Project description

dbt Run Analyser

Coverage Badge

This package can help you analyse your dbt runs, and help you ensure you're using your threads most optimal.

Installation

pip install dbt-run-analyser

Example

See a set of examples in the plot.ipynb file.

Using the CLI

The dbt-run-analyser CLI allows you to analyze your dbt run logs and manifest files to gain insights into your dbt runs. Here is a basic example of how to use the CLI:

  1. Plot Run Times: To plot the run times of your dbt models, use the following command:

    dbt-run-analyser plot-run-times "path/to/manifest.json" "path/to/dbt_run.log"
    
  2. Plot Critical Path: Show the critical path through the run:

    dbt-run-analyser plot-critical-path "path/to/manifest.json" "path/to/dbt_run.log" --model "order_wide"
    

Replace "path/to/manifest.json" and "path/to/dbt_run.log" with the actual paths to your dbt manifest file and run log file, respectively.

Functionalities to come

  • cli interface.
  • Improvements/decrease in run time if threads are added or removed.
  • Identification of bottlenecks.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_run_analyser-0.3.1.tar.gz (14.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_run_analyser-0.3.1-py3-none-any.whl (12.5 kB view details)

Uploaded Python 3

File details

Details for the file dbt_run_analyser-0.3.1.tar.gz.

File metadata

  • Download URL: dbt_run_analyser-0.3.1.tar.gz
  • Upload date:
  • Size: 14.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.10

File hashes

Hashes for dbt_run_analyser-0.3.1.tar.gz
Algorithm Hash digest
SHA256 eee847a1b56d2050bba8ceebf3b8398d85fd901c3a81c7f8389b1781b199ce23
MD5 d82f2ce232f43c8d73ed8b51568a0c45
BLAKE2b-256 80b083baaf964a682d22dad03e57363fd9a045ce3b1b5c9376e54e7b9905b384

See more details on using hashes here.

File details

Details for the file dbt_run_analyser-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_run_analyser-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f18d8b5fe9bfdf2835b718df69b360b30e1a6964c3cf4d7b11b97136793d02ac
MD5 6a3c7626cbc1e0a54bf05e2c44ffd06a
BLAKE2b-256 49cce751f7a93e0839b5028b8a94c0c549cffa41dd5fe5bf0e7422329caed00f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page