digdaglog2sql

Install

pip install --user digdaglog2sql

or,

$ python -m venv .venv
$ source .venv/bin/activate
(.venv)$ pip install digdaglog2sql

Usage

$ digdaglog2sql --help
Usage: digdaglog2sql [OPTIONS]

Input log by file:
  --input FILENAME               Input file name of a workflow log. Use - for
                                 STDIN.

Download log by Session ID:
  --session-id INTEGER           Session ID of the target workflow.
  --site [us|jp|eu01|ap02|ap03]  Treasure Workflow site name.  [default: us]
  --endpoint TEXT                Digdag server endpoint.
  --http                         Enforce to use http schema.

Output:
  --output FILENAME              Output file name. Use - for STDOUT.  [required]

Other options:
  --drop-cdp-db                  If true, drop cdp_audience_xxx DB name.
  --help                         Show this message and exit.

Constraints:
  {--input, --session-id}  exactly 1 required
  {--site, --endpoint}     exactly 1 required if --session-id is set
  {--site, --http}         mutually exclusive

You can use log file on local environment.

digdaglog2sql --input workflow-log.txt --output output.sql

Or, you can use Session ID of Treasure Workflow.

digdaglog2sql --session-id 12345 --site us --output output.sql

Ensure set TD_API_KEY into environment variable.