Skip to main content

View Selection Tool for dbt (python part)

Project description

ViewSelectionAdvisor

Welcome to ViewSelectionAdvisor, a tool designed to inform dbt users about the problem of model materialization. This tool consists of two separate packages working together, each with their own GitHub repository:

Installation Instructions

We assume you have a working dbt project for which you want advice. If so, follow the following steps:

  1. Clone or Download the Python Package:
    In a convenient location, either clone this repo by running:
    git clone https://github.com/bramreinders97/view_selection_tool_python.git,
    or download the src folder from this repository. Ensure you know the absolute filepath of the chosen location, you'll need it in the first step of the usage instructions.

  2. Ensure the following packages are installed in the venv that is used:

    ruamel-yaml = "^0.18.6"
    psycopg2 = "^2.9.9"
    

Usage Instructions

  1. In not done already, follow the installation and usage instructions of the dbt part of ViewSelectionAdvisor. The dbt part has to be run before the python part.

  2. Choose max number models to materialize:
    Right now, ViewSelectionAdvisor by default only looks at a maximum of 2 models to materialize. This can be changed manually in the MAX_MODELS_TO_MATERIALIZE.py file by changing the corresponding variable there.

  3. Obtain the advice on which models to materialize: From inside the root directory of your dbt project (from the same location as where you would call dbt run), call main.py:
    python path/to/src/main.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

view_selection_python-0.1.2.tar.gz (14.7 kB view details)

Uploaded Source

Built Distribution

view_selection_python-0.1.2-py3-none-any.whl (19.6 kB view details)

Uploaded Python 3

File details

Details for the file view_selection_python-0.1.2.tar.gz.

File metadata

  • Download URL: view_selection_python-0.1.2.tar.gz
  • Upload date:
  • Size: 14.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.11.5 Windows/10

File hashes

Hashes for view_selection_python-0.1.2.tar.gz
Algorithm Hash digest
SHA256 6293c033094cab680c73bc25282466ff0994c7ee41b4e9c5799a9ec8b2c93fa6
MD5 b654a72eeaa6a9e1ce11eaad6d9b76ae
BLAKE2b-256 ef054b72b0053a2b39abe2d1dcaba9df0f6a6046b72d9cf7b2fbd67767c0be42

See more details on using hashes here.

File details

Details for the file view_selection_python-0.1.2-py3-none-any.whl.

File metadata

File hashes

Hashes for view_selection_python-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 4826dec2675dd1440dd408570d88e6f3bb07d08a971ee74353cfbb07b829a878
MD5 1414241a8483062a60abf2c41590d1ce
BLAKE2b-256 2057239422f9a9252195ddaa9e785ca2e61c5529cbf59eb996eb6ca93ea8f393

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page