Fivetran Package Config Auto-Generator

# TODO: Find snappier name

The Fivetran Packge Auto-Generator can be used to update your dbt project with the required configuration for Fivetran-created dbt packages.

It will:

• Update your packages.yml file
• Update variable configurations in your dbt_project.yml file
• Update model/test configurations in your dbt_project.yml file (if necessary)

Installation

Install the auto-generator using pip:

pip3 install fivetran-autogen==0.0.1rc8     

Usage

Generating API credentials

The auto-generator uses the Fivetran API to fetch which packages you can install. Follow these instructions to generate your API credentials. These will be required for the next step.

Running the auto-generator

To user the auto-generator, run the following command from the root of your dbt project, i.e. the folder that has your dbt_project.yml file:

fivetran_autogen

You will then get prompted to:

• Input your API credentials
• Select which package you want to install
• Answer any package specific questions, i.e. what project/dataset the source data is located in

The auto-generator will query your database to collect information as well, using the profile associated with the dbt project.

Test the configuration

Once complete, you should see updated changes to your packages.yml and dbt_project.yml files.

To test out the configuration, run the following commands:

dbt deps
dbt run