humanity_etl

Replicate data from humanity in databricks

Usage

CLI

python -m humanity_etl --table <table-name>

where table-name is one of the following: timeclocks or ALL.

API

from humanity_etl.tables.timeclocks import timeclocks

timeclocks()

Further configs are set via environment variables:

Further configs are set via environment variables:

• *_ACCESS_TOKEN: API access
• APP_ENV: <development/production> - debug mode
• SAMPLE_OUTPUT: <True/False> - Save dataframes to csv

DEV

Create venv

python -m venv env

Activate venv

• unix

source env/bin/activate

• windows

env\Scripts\activate.bat

Install Packages

pip install -r requirements.txt

Test

make test

Format

make format

make lint

Version & Release

bump2version <major/minor/patch>

make release

note Don't forget to git push with --tags

pre-commit

Setup

pre-commit install

Run all

make pre-commit