library of functions for managing and improving data quality in Datasets
Project description
Data-Quality-Kit
Functional Description
A library of functions for managing and improving data quality in Datasets
Owner
For any bugs or questions, please reach out to Dante Pedrozo
Branching Methodology
This project follows a Git Flow simplified branching methodology
- Master Branch: production code
- Develop Branch: main integration branch for ongoing development. Features and fixes are merged into this branch before reaching master
- Feature Branch: created from develop branch to work on new features
Prerequisites
This project uses:
- Language: Python 3.10
- Libraries:
- pandas
- pytest
- assertpy
How to use it
Install the library
pip install data-quality-kit
from data_quality_quick.validate_formats import check_type_format
Functionalities
- Completeness
- assert_that_dataframe_is_empty: Check if a DataFrame is empty.
- Validity
- assert_that_there_are_not_nulls: Checks for null values in a specified column of a DataFrame.
- Consistency
- assert_that_there_are_not_duplicates: Checks for duplicate values in the specified primary key column of a DataFrame.
- assert_that_columns_values_match : Check if all values in column2 of df2 are present in column1 of df1.
- check_type_format: Check if all non-null entries in a specified column of a DataFrame are of the specified data type.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
data_quality_kit-0.5.0.tar.gz
(8.7 kB
view hashes)
Built Distribution
Close
Hashes for data_quality_kit-0.5.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c2333176784c624381dab62a8df7f0ece6d752c55384adbbb37de3c667528cf |
|
MD5 | 6878768b8f3604ff5267e4a961a22aea |
|
BLAKE2b-256 | 4e48775d7054fa3a541efa9df624bfdd32ddf5e48a56b362f4abda45ae35885c |