softwrdwrangler 0.0.14

A package to wrangle software data in the cloud.

softwrdwrangler

It will wrangle various aws resources

pre-requisites

you need to have aws cli installed and configured with the necessary permissions aws cli installation

aws configure

Installation

pip install softwrdwrangler

Usage

S3 read and write pickle

import softwrdwrangler as swr
data = swr.read_pickle(<s3_uri>)
swr.write_pickle(data, <s3_uri>)

S3 read and write json

import softwrdwrangler as swr
d = {'a': 1, 'b': 2}
swr.write_json(d, 's3://bucket/key.json')
print(swr.read_json('s3://bucket/key.json'))

S3 read and write csv

import softwrdwrangler as swr

data = swr.read_csv(<s3_uri>)
swr.write_csv(data, <s3_uri>)

License

Apache Software License