Skip to main content

View Selection Tool for dbt (python part)

Project description

ViewSelectionAdvisor

Welcome to ViewSelectionAdvisor, a tool designed to inform dbt users about the problem of model materialization. This tool consists of two separate packages working together, each with their own GitHub repository:

Installation Instructions

We assume you have a working dbt project for which you want advice. If so, follow the following steps:

  1. Clone or Download the Python Package:
    In a convenient location, either clone this repo by running:
    git clone https://github.com/bramreinders97/view_selection_tool_python.git,
    or download the src folder from this repository. Ensure you know the absolute filepath of the chosen location, you'll need it in the first step of the usage instructions.

  2. Ensure the following packages are installed in the venv that is used:

    ruamel-yaml = "^0.18.6"
    psycopg2 = "^2.9.9"
    

Usage Instructions

  1. In not done already, follow the installation and usage instructions of the dbt part of ViewSelectionAdvisor. The dbt part has to be run before the python part.

  2. Choose max number models to materialize:
    Right now, ViewSelectionAdvisor by default only looks at a maximum of 2 models to materialize. This can be changed manually in the MAX_MODELS_TO_MATERIALIZE.py file by changing the corresponding variable there.

  3. Obtain the advice on which models to materialize: From inside the root directory of your dbt project (from the same location as where you would call dbt run), call main.py:
    python path/to/src/main.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

view_selection_python-0.1.4.tar.gz (15.7 kB view details)

Uploaded Source

Built Distribution

view_selection_python-0.1.4-py3-none-any.whl (20.9 kB view details)

Uploaded Python 3

File details

Details for the file view_selection_python-0.1.4.tar.gz.

File metadata

  • Download URL: view_selection_python-0.1.4.tar.gz
  • Upload date:
  • Size: 15.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.11.5 Windows/10

File hashes

Hashes for view_selection_python-0.1.4.tar.gz
Algorithm Hash digest
SHA256 fe8c4c809c38e60cffa69d3bc0b3b40ba440e4af48b0db3ac824712c4aae8192
MD5 1d257fb8f75ac58b255ae0792525148f
BLAKE2b-256 e12d60fd306a4d16575dbf9422c111649caf7b35bec18aa12ac95b86d01c3f92

See more details on using hashes here.

File details

Details for the file view_selection_python-0.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for view_selection_python-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 a4a3535cc6603e436fecc3e27851ef63189aab4bb7f8522a29df5158748e62bf
MD5 c39299cfcbc7817590eab6a361c299f7
BLAKE2b-256 2c9a8d46ac994e4e35c0fc38b9da04d2ce3a07d2c30374acd4e7779ad98ee344

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page