sankir-sdf 0.0.8

SDF Converter

Steps to run (GCP)

1. Install sankir-sdf

pip3 install sankir-sdf

2. Create a config.json containing following fields:

{
    "cloud": "AWS|GCP|AZURE",
    "bucket_name":"sankir-storage-prospark",
    "input_path":"data/retail-data/q1",
    "output_path":"processed-retail-data/",
    "reconciliation": "recon.reconciliation"
}

3. Set GOOGLE_APPLICATION_CREDENTIALS environment variable

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/creds.json

4. Put sankir-sdf in path

export PATH=$PATH:$HOME/.local/bin

5. Run the program with:

sankir-sdf /path/to/config.json