Skip to main content

View Selection Tool for dbt (python part)

Project description

ViewSelectionAdvisor

Welcome to ViewSelectionAdvisor, a tool designed to inform dbt users about the problem of model materialization. This tool consists of two separate packages working together, each with their own GitHub repository:

Installation Instructions

We assume you have a working dbt project for which you want advice. If so, follow the following steps:

  1. Clone or Download the Python Package:
    In a convenient location, either clone this repo by running:
    git clone https://github.com/bramreinders97/view_selection_tool_python.git,
    or download the src folder from this repository. Ensure you know the absolute filepath of the chosen location, you'll need it in the first step of the usage instructions.

  2. Ensure the following packages are installed in the venv that is used:

    ruamel-yaml = "^0.18.6"
    psycopg2 = "^2.9.9"
    

Usage Instructions

  1. In not done already, follow the installation and usage instructions of the dbt part of ViewSelectionAdvisor. The dbt part has to be run before the python part.

  2. Choose max number models to materialize:
    Right now, ViewSelectionAdvisor by default only looks at a maximum of 2 models to materialize. This can be changed manually in the MAX_MODELS_TO_MATERIALIZE.py file by changing the corresponding variable there.

  3. Obtain the advice on which models to materialize: From inside the root directory of your dbt project (from the same location as where you would call dbt run), call main.py:
    python path/to/src/main.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

view_selection_python-0.1.1.tar.gz (14.4 kB view details)

Uploaded Source

Built Distribution

view_selection_python-0.1.1-py3-none-any.whl (19.4 kB view details)

Uploaded Python 3

File details

Details for the file view_selection_python-0.1.1.tar.gz.

File metadata

  • Download URL: view_selection_python-0.1.1.tar.gz
  • Upload date:
  • Size: 14.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.11.5 Windows/10

File hashes

Hashes for view_selection_python-0.1.1.tar.gz
Algorithm Hash digest
SHA256 f0b15546c29489ba1341b16e11efb18f88b7e55def173ba33ac9a073ebe3d36c
MD5 b7fafe88e805411cf52fed8c54929812
BLAKE2b-256 d8c42805bb7b7e7483b9ce68207d506de1e7fcd591e6a4b8be962b28c8239e13

See more details on using hashes here.

File details

Details for the file view_selection_python-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for view_selection_python-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 6443254a09e1728c5fc1ffef4cccf5440ae0736e67123b1cd962f7d1b18f0197
MD5 2cca66bf4b0681b1d79be402f3331373
BLAKE2b-256 6d24e397d0e3290861a62e8bf15eb8558aaed8f66862fb848032bd34a6420408

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page