Skip to main content

Auxiliary functions to clean pandas data frames

Project description

Pywrangle

About

PyWrangle is an open-source Python library for data wrangling. Wikipedia defines data wrangling as follows:

is the process of transforming and mapping data from one "raw" data form into another format with the intent of making it more appropriate and valuable for a variety of downstream purposes such as analytics

Functions

PyWrangle currently supports:

  • cleaning strings
  • tracking dataframe changes
  • identifying data entry errors

Documentation & Distribution

Documentation is available here

Distribution is available here

Install

Requirements

  • Python >= 3.8
  • numpy >= 1.14.4
  • pandas >= 1.0.3
  • fuzzywuzzy >= 0.18.0
  • python-levenshtein >= 0.12.0
  • metaphone >= 0.6

Pip Install

To install pywrangle, use pip:

pip install pywrangle

Import

Per convention with Python libraries for data science, import pywrangle as follows:

>>> import pywrangle as pw

Contributing

Like all developers, I love open source. Please reference the contributing guidelines here

History

Version = "0.3.0"

  • Removed identify missing data from library -- too much overlap with the missingno library.
  • Added identify_errors() function. Uses levenshtein's distance & double metaphone string matching algorithms to identify potential data entry errors in string columns.
  • Refactored code into different sub libraries
  • Placed documentation on ReadTheDocs.

version = "0.2.40"

  • refactored code for clarity
  • added display info to print_df_changes

version = "0.2.1"

  • Created init file for function imports
  • Documentation on importing pywrangle
  • Added numpy as required package.
  • Changed package requirements to greater than or equal to.

version = "0.0.1"

  • Init

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pywrangle-0.3.2.tar.gz (20.4 kB view details)

Uploaded Source

File details

Details for the file pywrangle-0.3.2.tar.gz.

File metadata

  • Download URL: pywrangle-0.3.2.tar.gz
  • Upload date:
  • Size: 20.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.53.0 CPython/3.9.0

File hashes

Hashes for pywrangle-0.3.2.tar.gz
Algorithm Hash digest
SHA256 b0fe58ed95657458d2a21f4aa3ec27da7c54e2fe0ee75f94bc8658b1cc629884
MD5 92b2f5e00674854245ff477d48b71da0
BLAKE2b-256 9975db21b34a9787eff4c1585e159251836e15425b9722edc21b7660e2f473c2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page