iterable-etl 0.2.0

Replicate iterable data in databricks

iterable_etl

Replicate data from iterable in databricks

Usage

CLI

python -m iterable_etl --table <table-name>

where is one of the following: campaign_history, campaign_metrics, campaign_list_history, list, or ALL.

API

from iterable_etl.tables.campaign_history import campaign_history_df
from iterable_etl.tables.campaign_metrics import campaign_metrics_df
from iterable_etl.tables.list import list_df
from iterable_etl.tables.campaign_list_history import campaign_list_history_df

campaign_history_df()
campaign_metrics_df()
list_df()
campaign_list_history_df()

Further configs are set via environment variables:

• ITERABLE_KEY: API access
• APP_ENV: <development/production> - debug mode
• SAMPLE_OUTPUT: <True/False> - Save dataframes to csv

DEV

Create venv

python -m venv env

Activate venv

• unix

source env/bin/activate

• windows

env\Scripts\activate.bat

Install Packages

pip install -r requirements.txt

Test

make test

Format

make format

make lint

Version & Release

bump2version <major/minor/patch>

make release

note Don't forget to git push with --tags

pre-commit

Setup

pre-commit install

Run all

make pre-commit