Skip to main content

Pandas on AWS.

Project description

AWS Data Wrangler

Pandas on AWS


NOTE

We just released a new major version 1.0 with breaking changes. Please make sure that all your old projects has dependencies frozen on the desired version (e.g. pip install awswrangler==0.3.2).


AWS Data Wrangler

Release Python Version Code style: black License Checked with mypy Average time to resolve an issue

Coverage Static Checking Documentation Status

Source Downloads Page Installation Command
PyPi PyPI Downloads Link pip install awswrangler
Conda Conda Downloads Link conda install -c conda-forge awswrangler

Quick Start

Install the Wrangler with: pip install awswrangler

import awswrangler as wr
import pandas as pd

df = pd.DataFrame({"id": [1, 2], "value": ["foo", "boo"]})

# Storing data on Data Lake
wr.s3.to_parquet(
    df=df,
    path="s3://bucket/dataset/",
    dataset=True,
    database="my_db",
    table="my_table"
)

# Retrieving the data directly from Amazon S3
df = wr.s3.read_parquet("s3://bucket/dataset/", dataset=True)

# Retrieving the data from Amazon Athena
df = wr.athena.read_sql_query("SELECT * FROM my_table", database="my_db")

Read The Docs

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

awswrangler-1.0.3.tar.gz (47.6 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

awswrangler-1.0.3-py3.6.egg (113.5 kB view details)

Uploaded Egg

awswrangler-1.0.3-py3-none-any.whl (53.4 kB view details)

Uploaded Python 3

File details

Details for the file awswrangler-1.0.3.tar.gz.

File metadata

  • Download URL: awswrangler-1.0.3.tar.gz
  • Upload date:
  • Size: 47.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.6.10

File hashes

Hashes for awswrangler-1.0.3.tar.gz
Algorithm Hash digest
SHA256 4cb6acd2ebd9715f9784039df61ddcfad436de105be712363cd534c2aa4e0022
MD5 25acc847b199d963433f9fd3485cba03
BLAKE2b-256 34f89fff19a4474d48b63a7900ceb5d7f07d50bd8259b5d78995b47ab7e220b4

See more details on using hashes here.

File details

Details for the file awswrangler-1.0.3-py3.6.egg.

File metadata

  • Download URL: awswrangler-1.0.3-py3.6.egg
  • Upload date:
  • Size: 113.5 kB
  • Tags: Egg
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.6.10

File hashes

Hashes for awswrangler-1.0.3-py3.6.egg
Algorithm Hash digest
SHA256 5609afb47c45ba8491bb882820e0a0996056bca01eb53b2ccfa6513b247bae07
MD5 2a66a37b227ede43e67e282bce02f270
BLAKE2b-256 e68b19bdc3c76f090f330d855cceb16028c6b92679f16c337547aec2650c7c6d

See more details on using hashes here.

File details

Details for the file awswrangler-1.0.3-py3-none-any.whl.

File metadata

  • Download URL: awswrangler-1.0.3-py3-none-any.whl
  • Upload date:
  • Size: 53.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.6.10

File hashes

Hashes for awswrangler-1.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 d1b4eceae26ebf9766b88d489cc54ab6d6e441265d147cd21edae93190675509
MD5 ceefabeeada074124b3f380745aed35f
BLAKE2b-256 d28263d4b2ed2502de10b044e4cb053ad9e2913a2e0d2c684d2f3f5170bab22a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page