Pandas on AWS.
Project description
AWS Data Wrangler
Pandas on AWS
Source | Downloads | Page | Installation Command |
---|---|---|---|
PyPi | Link | pip install awswrangler |
|
Conda | Link | conda install -c conda-forge awswrangler |
Quick Start
Install the Wrangler with: pip install awswrangler
import awswrangler as wr
import pandas as pd
df = pd.DataFrame({"id": [1, 2], "value": ["foo", "boo"]})
# Storing data on Data Lake
wr.s3.to_parquet(
df=df,
path="s3://bucket/dataset/",
dataset=True,
database="my_db",
table="my_table"
)
# Retrieving the data directly from Amazon S3
df = wr.s3.read_parquet("s3://bucket/dataset/", dataset=True)
# Retrieving the data from Amazon Athena
df = wr.athena.read_sql_query("SELECT * FROM my_table", database="my_db")
Read The Docs
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
awswrangler-1.0.0.tar.gz
(44.9 kB
view hashes)
Built Distributions
awswrangler-1.0.0-py3.6.egg
(106.6 kB
view hashes)
Close
Hashes for awswrangler-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6936979ef03c36e1b996ce401e14c679114fa06453e6a9fb2dd758ad6c7d7de8 |
|
MD5 | 0d38fb1c0fa389e86aa4a32ba81ad875 |
|
BLAKE2b-256 | 2c3076e58d4cf292347e3b03b8765f16b6bd85a0b8862f0b26682e3ef81b2ba8 |