Replicate iterable data in databricks
Project description
iterable_etl
Replicate data from iterable in databricks
CLI
python -m iterable_etl --table <table-name>
where is one of the following: campaign_history
, campaign_metrics
, campaign_list_history
, list
, or ALL
.
API
from iterable_etl.tables.campaign_history import campaign_history_df
from iterable_etl.tables.campaign_metrics import campaign_metrics_df
from iterable_etl.tables.list import list_df
from iterable_etl.tables.campaign_list_history import campaign_list_history_df
campaign_history_df()
campaign_metrics_df()
list_df()
campaign_list_history_df()
Further configs are set via environment variables:
ITERABLE_KEY
: API accessAPP_ENV
: <development/production> - debug modeSAMPLE_OUTPUT
: <True/False> - Save dataframes to csv
DEV
Create venv
python -m venv env
Activate venv
- unix
source env/bin/activate
- windows
env\Scripts\activate.bat
Install Packages
pip install -r requirements.txt
Test
make test
Format
make format
make lint
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
iterable_etl-0.0.1rc4.tar.gz
(5.9 kB
view details)
File details
Details for the file iterable_etl-0.0.1rc4.tar.gz
.
File metadata
- Download URL: iterable_etl-0.0.1rc4.tar.gz
- Upload date:
- Size: 5.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.14.0 pkginfo/1.9.6 requests/2.28.2 setuptools/58.1.0 requests-toolbelt/0.10.1 tqdm/4.65.0 CPython/3.9.16
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b2948d0861d3c4b12a1d200ef922367e37be87611c31247ed0094ca6dcddd731 |
|
MD5 | 708fb6b2f65b218f58748efeda3516e8 |
|
BLAKE2b-256 | afa4a52bd892298f3d7cd7128158abfcc0300a6b29e6634b573dd2a2135823dc |