Skip to main content

Dataprep: Data Preparation in Python

Project description

Dataprep Build Status

Documentation | Mail List & Forum

Dataprep let you prepare your data using a single library with a few lines of code.

Currently, you can use dataprep to:

  • Collect data from common data sources (through dataprep.data_connector)
  • Do your exploratory data analysis (through dataprep.eda)
  • ...more modules are coming

Installation

pip install dataprep

Examples & Usages

The following examples can give you an impression of what dataprep can do:

EDA

There are common tasks during the exploratory data analysis stage, like a quick look at the columnar distribution, or understanding the correlations between columns.

The EDA module categorizes these EDA tasks into functions helping you finish EDA tasks with a single function call.

  • Want to understand the distributions for each DataFrame column? Use plot.
  • Want to understand the correlation between columns? Use plot_correlation.
  • Or, if you want to understand the impact of the missing values for each column, use plot_missing.
  • You can drill down to get more information by given plot, plot_correlation and plot_missing a column name. E.g. for plot_missing:

Don't forget to checkout the examples folder for detailed demonstration!

Data Connector

You can download Yelp business search result into a pandas DataFrame, using two lines of code, without taking deep looking into the Yelp documentation!

from dataprep.data_connector import Connector

dc = Connector("yelp", auth_params={"access_token":"<Your yelp access token>"})
df = dc.query("businesses", term="korean", location="seattle")

Contribution

Dataprep is in its early stage. Any contribution including:

  • Filing an issue
  • Providing use cases
  • Writing down your user experience
  • Submitting a PR
  • ...

are greatly appreciated!

Please take a look at our wiki for development documentations!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataprep-0.2.4.tar.gz (44.1 kB view details)

Uploaded Source

Built Distribution

dataprep-0.2.4-py3-none-any.whl (54.5 kB view details)

Uploaded Python 3

File details

Details for the file dataprep-0.2.4.tar.gz.

File metadata

  • Download URL: dataprep-0.2.4.tar.gz
  • Upload date:
  • Size: 44.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.7.5 Linux/4.4.0-169-generic

File hashes

Hashes for dataprep-0.2.4.tar.gz
Algorithm Hash digest
SHA256 33656b12f237feefd948dce2cff9a77ecbed29d7c2a566681589ef0f726ba4b2
MD5 fe4a5c0366e7b3f0103162972d38d675
BLAKE2b-256 9b10030253ae4a5929b3887751a8a5fdf894cfaf93f9b6e801b8a708a685fa51

See more details on using hashes here.

File details

Details for the file dataprep-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: dataprep-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 54.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.7.5 Linux/4.4.0-169-generic

File hashes

Hashes for dataprep-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 8c3a1662ee90d0f9399d286f5ac5f1870355efa543688e7da078fa0f9a0cb737
MD5 96b16ad44e30e6f7a6c2a535fca6e351
BLAKE2b-256 13151bd5c6462d285e0855c61f88294daeef9054f3289dce024933ebaf37a453

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page