CLI tool for datalake operation
Project description
shopcloud-datalake-cli
Datalake ETL tool
mkdir config-dir
$ datalake --project="evident-castle-411608" --base-dir="examples" config create
$ datalake --project="evident-castle-411608" --base-dir="examples" config sync
$ datalake --project="evident-castle-411608" --base-dir="examples" run --partition-date=2024-01-19
$ datalake --project="evident-castle-411608" --base-dir="examples" run <table> --partition-date=2024-01-19
Development
# run unit tests
$ python3 -m unittest
# run unit tests with coverage
$ python3 -m coverage run --source=tests,shopcloud_datalake -m unittest discover && python3 -m coverage html -d coverage_report
$ python3 -m coverage run --source=tests,shopcloud_datalake -m unittest discover && python3 -m coverage xml
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
shopcloud-datalake-1.3.0.tar.gz
(17.2 kB
view hashes)
Built Distribution
Close
Hashes for shopcloud_datalake-1.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dcd8e9c0d3d28405fa143d36feb24c21407410c4ac2121799e1aec5f3578f99e |
|
MD5 | 5525629b689206210aac6995fdb9a7d8 |
|
BLAKE2b-256 | 8d4c68d8250a8971e7e51250dac9849c5cb49bd79a33118fd676932d648c9aeb |