Skip to main content

Python library for working with Amazon Web Services such as Redshift and S3

Project description

Amazonian

Amazonian is a Python library for interacting easily with Amazon S3 and Redshift.

Installation

pip install amazonian

Usage

S3

from amazonian import S3

s3 = S3(key=None, secret=None, iam_role=None, root='s3://', spark=spark)

# get list of files:
s3.ls(path='s3://bucket/directory/subdirectory')

# get a tree representation of folder structure
s3.tree(path='s3://bucket/directory/subdirectory')

# get file size:
s3.get_size(path='some_file')

# save a Spark DataFrame as a Parquet
s3.save_parquet(data=my_data, path='s3://bucket/directory/subdirectory/name.parquet')

# load a Parquet into a Spark DataFrame
my_data = s3.load_parquet(path='s3://bucket/directory/subdirectory/name.parquet')

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

amazonian-2022.5.27.tar.gz (14.7 kB view details)

Uploaded Source

Built Distribution

amazonian-2022.5.27-py3-none-any.whl (18.6 kB view details)

Uploaded Python 3

File details

Details for the file amazonian-2022.5.27.tar.gz.

File metadata

  • Download URL: amazonian-2022.5.27.tar.gz
  • Upload date:
  • Size: 14.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5

File hashes

Hashes for amazonian-2022.5.27.tar.gz
Algorithm Hash digest
SHA256 fb4e4fc9334cfd7885481089c5c49cead3e7f8b484752a0799c3fc57fec7256e
MD5 34094f9317e8da23ba6b9227cec67d7c
BLAKE2b-256 074b62848de13c11722a30e9e79bd620d82d115477875e787114180438b67666

See more details on using hashes here.

File details

Details for the file amazonian-2022.5.27-py3-none-any.whl.

File metadata

  • Download URL: amazonian-2022.5.27-py3-none-any.whl
  • Upload date:
  • Size: 18.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5

File hashes

Hashes for amazonian-2022.5.27-py3-none-any.whl
Algorithm Hash digest
SHA256 aaf6101fd236c1012a917a38fef3a2d30be2beacb871a3d0ec9c65cde1dc51dd
MD5 08e221132890d915fe79c644e872edc5
BLAKE2b-256 669f6856557af5a83c7404d56ecb98293fcab4996de991895a71c2a38ff546ed

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page