Extract SQLs from digdag log
Project description
digdaglog2sql
Install
pip install --user digdaglog2sql
or,
$ python -m venv .venv
$ source .venv/bin/activate
(.venv)$ pip install digdaglog2sql
Usage
$ digdaglog2sql --help
Usage: digdaglog2sql [OPTIONS]
Input log by file:
--input FILENAME Input file name of a workflow log. Use - for
STDIN.
Download log by Session ID:
--session-id INTEGER Session ID of the target workflow.
--site [us|jp|eu01|ap02|ap03] Treasure Workflow site name. [default: us]
--endpoint TEXT Digdag server endpoint.
--http Enforce to use http schema.
Output:
--output FILENAME Output file name. Use - for STDOUT. [required]
Other options:
--drop-cdp-db If true, drop cdp_audience_xxx DB name.
--help Show this message and exit.
Constraints:
{--input, --session-id} exactly 1 required
{--site, --endpoint} exactly 1 required if --session-id is set
{--site, --http} mutually exclusive
You can use log file on local environment.
digdaglog2sql --input workflow-log.txt --output output.sql
Or, you can use Session ID of Treasure Workflow.
digdaglog2sql --session-id 12345 --site us --output output.sql
Ensure set TD_API_KEY
into environment variable.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
digdaglog2sql-0.1.0.tar.gz
(7.1 kB
view hashes)
Built Distribution
Close
Hashes for digdaglog2sql-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6be282aa08056d2c7f1ef19cc36d94be30196bb6d1c6fec801595fcb6e49d57d |
|
MD5 | 5a13104e1683de5d7c19cf692162d64d |
|
BLAKE2b-256 | 8f66b5a3e49e9b3a002f5da23fd32cdaa7b84862a25a54af33fd2976d3b183c3 |