Auxiliary functions to clean pandas data frames
Project description
Pywrangle
Library with auxiliary functions to clean pandas data frames. Available on PyPI here
Install
- Python 3.6+
- numpy
- pandas
To install pywrangle, use pip:
pip install pywrangle
Import
Per convention with Python Analysis modules, import pywrangle as follows:
>>> import pywrangle as pw
Missing Data
print_nulls_per_col(df) -> None:
Calculates number of null values in each column and prints result.
String cleaning
def clean_str_columns(df: object, col_strcase_tuple: tuple) -> df:
Master function to clean string columns using col_strcase_tuple key.
TODO:
TODO lists available in pywrangle functions.
- Add testing documentation.
- Missing data functions
- show correlation between NULL values in different columns. e.g., if state is missing, likely region is missing too
- barchart with number of NULL per num columns
- show number of rows with NULL in only 1 column, 2 columns, 3 columns etc.
- May like to include optional parameters to show correlation b/w NULL values in different columns?
- Print number of rows with NULL in X columns - optional param for desc sort by num NULL?
- Create wrapper that prints changes in the data frame size.
- Helpful when dropping is_na rows.
- Can create optional param to assert that dropped_rows = num_na before
- Create pywrangle documentation website?
History
version = "0.2.40"
- refactored code for clarity
- added display info to print_df_changes
version = "0.2.1"
- Created init file for function imports
- Documentation on importing pywrangle
- Added numpy as required package.
- Changed package requirements to greater than or equal to.
version = "0.0.1"
- Init
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pywrangle-0.2.40.tar.gz
(7.2 kB
view details)
File details
Details for the file pywrangle-0.2.40.tar.gz
.
File metadata
- Download URL: pywrangle-0.2.40.tar.gz
- Upload date:
- Size: 7.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/49.5.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8195cc6d4525b96f1f1b1cf6d8291b17eda78609a8bb192dfef1dcf3e4efb616 |
|
MD5 | c7cab12f024c2a94647c130bc2119df7 |
|
BLAKE2b-256 | acaff1649ee8e0e77eab54df95ac6ff80fb51567cb8e283772a5532d14eb1961 |