Python library for working with Amazon Web Services such as Redshift and S3
Project description
Amazonian
Amazonian is a Python library for interacting easily with Amazon S3 and Redshift.
Installation
pip install amazonian
Usage
S3
from amazonian import S3
s3 = S3(key=None, secret=None, iam_role=None, root='s3://', spark=spark)
# get list of files:
s3.ls(path='s3://bucket/directory/subdirectory')
# get a tree representation of folder structure
s3.tree(path='s3://bucket/directory/subdirectory')
# get file size:
s3.get_size(path='some_file')
# save a Spark DataFrame as a Parquet
s3.save_parquet(data=my_data, path='s3://bucket/directory/subdirectory/name.parquet')
# load a Parquet into a Spark DataFrame
my_data = s3.load_parquet(path='s3://bucket/directory/subdirectory/name.parquet')
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
amazonian-2022.5.27.tar.gz
(14.7 kB
view details)
Built Distribution
File details
Details for the file amazonian-2022.5.27.tar.gz
.
File metadata
- Download URL: amazonian-2022.5.27.tar.gz
- Upload date:
- Size: 14.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb4e4fc9334cfd7885481089c5c49cead3e7f8b484752a0799c3fc57fec7256e |
|
MD5 | 34094f9317e8da23ba6b9227cec67d7c |
|
BLAKE2b-256 | 074b62848de13c11722a30e9e79bd620d82d115477875e787114180438b67666 |
File details
Details for the file amazonian-2022.5.27-py3-none-any.whl
.
File metadata
- Download URL: amazonian-2022.5.27-py3-none-any.whl
- Upload date:
- Size: 18.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | aaf6101fd236c1012a917a38fef3a2d30be2beacb871a3d0ec9c65cde1dc51dd |
|
MD5 | 08e221132890d915fe79c644e872edc5 |
|
BLAKE2b-256 | 669f6856557af5a83c7404d56ecb98293fcab4996de991895a71c2a38ff546ed |