sankir-sdf 0.0.1

SDF Converter

Steps to run script

1. Install google-cloud-storage Python library with

pip install -r requirements.txt

2. Create a config.json containing following three fields:

{
    "bucket_name": "sankir-storage-prospark",
    "input_path": "raw-retail-data/q1",
    "output_path": "processed-retail-data/"
}

3. Set GOOGLE_APPLICATION_CREDENTIALS environment variable

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/creds.json

4. Run the script with

python3 -m sdf /path/to/config.json