sankir-sdf 0.0.4

SDF Converter

Steps to run

1. Install sankir-sdf

pip3 install sankir-sdf

2. Create a config.json containing following fields:

{
    "bucket_name":"sankir-storage-prospark",
    "input_path":"data/retail-data/q1",
    "output_path":"processed-retail-data/",
    "bigquery_table_name": "recon.reconciliation",
    "reprocess": true
}

3. Set GOOGLE_APPLICATION_CREDENTIALS environment variable

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/creds.json

4. Run the program with:

sankir-sdf /path/to/config.json