Amazonian
Amazonian is a Python library for interacting easily with Amazon S3 and Redshift.
Installation
pip install amazonian
Usage
S3
from amazonian import S3
s3 = S3(key=None, secret=None, iam_role=None, root='s3://', spark=spark)
# get list of files:
s3.ls(path='s3://bucket/directory/subdirectory')
# get a tree representation of folder structure
s3.tree(path='s3://bucket/directory/subdirectory')
# get file size:
s3.get_size(path='some_file')
# save a Spark DataFrame as a Parquet
s3.save_parquet(data=my_data, path='s3://bucket/directory/subdirectory/name.parquet')
# load a Parquet into a Spark DataFrame
my_data = s3.load_parquet(path='s3://bucket/directory/subdirectory/name.parquet')
1 maintainer
Release files for amazonian 2022.5.27
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| amazonian-2022.5.27.tar.gz | 14.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| amazonian-2022.5.27-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 33.3 kB
Release files / amazonian-2022.5.27.tar.gz
| Download URL | amazonian-2022.5.27.tar.gz |
|---|---|
| Size | 14.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
fb4e4fc9334cfd7885481089c5c49cead3e7f8b484752a0799c3fc57fec7256e
|
|
BLAKE2b-256 checksum How to use checksums |
074b62848de13c11722a30e9e79bd620d82d115477875e787114180438b67666
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
|
Release files / amazonian-2022.5.27-py3-none-any.whl
| Download URL | amazonian-2022.5.27-py3-none-any.whl |
|---|---|
| Size | 18.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
aaf6101fd236c1012a917a38fef3a2d30be2beacb871a3d0ec9c65cde1dc51dd
|
|
BLAKE2b-256 checksum How to use checksums |
669f6856557af5a83c7404d56ecb98293fcab4996de991895a71c2a38ff546ed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
|
