Python library for working with Amazon Web Services such as Redshift and S3
Project description
Amazonian
Amazonian is a Python library for interacting easily with Amazon S3 and Redshift.
Installation
pip install amazonian
Usage
S3
from amazonian import S3
s3 = S3(key=None, secret=None, iam_role=None, root='s3://', spark=spark)
# get list of files:
s3.ls(path='s3://bucket/directory/subdirectory')
# get a tree representation of folder structure
s3.tree(path='s3://bucket/directory/subdirectory')
# get file size:
s3.get_size(path='some_file')
# save a Spark DataFrame as a Parquet
s3.save_parquet(data=my_data, path='s3://bucket/directory/subdirectory/name.parquet')
# load a Parquet into a Spark DataFrame
my_data = s3.load_parquet(path='s3://bucket/directory/subdirectory/name.parquet')
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
amazonian-2022.3.9.tar.gz
(14.3 kB
view hashes)
Built Distribution
Close
Hashes for amazonian-2022.3.9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8bbc150bd2722cc572514e6ef13a865edd90b360d3af20b2d75db00092f1b17b |
|
MD5 | b04f1ac4aeabf547b4cb9ddcbe14e8e3 |
|
BLAKE2b-256 | de4acbd18b9a2717c1e7abe842ca2838f95eedf1ac969ad19c07b25b2fe1c939 |