Package short description.
Project description
Welcome to s3iotools Documentation
Usage
import boto3
import pandas as pd
from s3iotools.io.dataframe import S3Dataframe
session = boto3.Session(profile_name="xxx")
s3 = session.resource("s3")
bucket_name = "my-bucket"
s3df = S3Dataframe(s3_resource=s3, bucket_name=bucket_name)
s3df.df = pd.DataFrame(...)
s3df.to_csv(key="data.csv")
s3df.to_csv(key="data.csv.gz", gzip_compressed=True)
s3df_new = S3Dataframe(s3_resource=s3, bucket_name=bucket_name, key="data.csv")
s3df_new.read_csv()
s3df_new.df # access data
s3df_new = S3Dataframe(s3_resource=s3, bucket_name=bucket_name, key="data.csv.gz")
s3df_new.read_csv(gzip_compressed=True)
s3df_new.df # access data
json IO is similar.
Install
s3iotools is released on PyPI, so all you need is:
$ pip install s3iotools
To upgrade to latest version:
$ pip install --upgrade s3iotools
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
s3iotools-0.0.1.tar.gz
(27.6 kB
view hashes)
Built Distribution
Close
Hashes for s3iotools-0.0.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0af60c09d406fbe9dd881226ddc4323939ec3ab64d9b1dd863ea3f0105a35894 |
|
MD5 | 68d6f8ab16ed5123db153fe83797c0e2 |
|
BLAKE2b-256 | d0c5b4bc25e48e7c73deeaff7f48e114b8c5a31605c56722bba013e2f0fe3d6e |