CLI tool for datalake operation
Project description
shopcloud-datalake-cli
Datalake ETL tool
mkdir config-dir
$ datalake --project="evident-castle-411608" --base-dir="examples" config create
$ datalake --project="evident-castle-411608" --base-dir="examples" config sync
$ datalake --project="evident-castle-411608" --base-dir="examples" run --partition-date=2024-01-19
$ datalake --project="evident-castle-411608" --base-dir="examples" run <table> --partition-date=2024-01-19
Development
# run unit tests
$ python3 -m unittest
# run unit tests with coverage
$ python3 -m coverage run --source=tests,shopcloud_datalake -m unittest discover && python3 -m coverage html -d coverage_report
$ python3 -m coverage run --source=tests,shopcloud_datalake -m unittest discover && python3 -m coverage xml
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
shopcloud-datalake-1.1.0.tar.gz
(16.1 kB
view hashes)
Built Distribution
Close
Hashes for shopcloud_datalake-1.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4ecd89715459ce0fbee1aa69372db642c9905455612ab78f7de913e5edd799f4 |
|
MD5 | ff3645b94a67aa580debcd23609707b7 |
|
BLAKE2b-256 | 5e96c161cc03a084042b6a690c4ab67d71f04d3b14e3aa1ff197895e1f86fc81 |