Skip to main content

View Selection Tool for dbt (python part)

Project description

ViewSelectionAdvisor

Welcome to ViewSelectionAdvisor, a tool designed to inform dbt users about the problem of model materialization. This tool consists of two separate packages working together, each with their own GitHub repository:

Installation Instructions

We assume you have a working dbt project for which you want advice. If so, follow the following steps:

  1. Clone or Download the Python Package:
    In a convenient location, either clone this repo by running:
    git clone https://github.com/bramreinders97/view_selection_tool_python.git,
    or download the src folder from this repository. Ensure you know the absolute filepath of the chosen location, you'll need it in the first step of the usage instructions.

  2. Ensure the following packages are installed in the venv that is used:

    ruamel-yaml = "^0.18.6"
    psycopg2 = "^2.9.9"
    

Usage Instructions

  1. In not done already, follow the installation and usage instructions of the dbt part of ViewSelectionAdvisor. The dbt part has to be run before the python part.

  2. Choose max number models to materialize:
    Right now, ViewSelectionAdvisor by default only looks at a maximum of 2 models to materialize. This can be changed manually in the MAX_MODELS_TO_MATERIALIZE.py file by changing the corresponding variable there.

  3. Obtain the advice on which models to materialize: From inside the root directory of your dbt project (from the same location as where you would call dbt run), call main.py:
    python path/to/src/main.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

view_selection_python-0.1.0.tar.gz (14.4 kB view details)

Uploaded Source

Built Distribution

view_selection_python-0.1.0-py3-none-any.whl (19.4 kB view details)

Uploaded Python 3

File details

Details for the file view_selection_python-0.1.0.tar.gz.

File metadata

  • Download URL: view_selection_python-0.1.0.tar.gz
  • Upload date:
  • Size: 14.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.11.5 Windows/10

File hashes

Hashes for view_selection_python-0.1.0.tar.gz
Algorithm Hash digest
SHA256 b8672ec50823a3f277da6171dba42c5947fdb1844ac5900e6a91b58e5fc2d32a
MD5 86203bbe22228ca0a6f74d8c2fff3a10
BLAKE2b-256 2baf2084f1d9a0233430c8868f91bf6e07ea1a9239b2e90182fe03e5a6fdc041

See more details on using hashes here.

File details

Details for the file view_selection_python-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for view_selection_python-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b3d6219776273d342f49bc8fc306e304a802f03adae8e5027271c2a327511903
MD5 3f590db8af454e41b4b1420c8fc60445
BLAKE2b-256 24ef4a8c2f2c336b0ff6a09dd103fe34012474ca01e24e0cada784d510a1f40f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page