library of functions for managing and improving data quality in Datasets
Project description
Data-Quality-Kit
Functional Description
A library of functions for managing and improving data quality in Datasets
Owner
For any bugs or questions, please reach out to Dante Pedrozo
Branching Methodology
This project follows a Git Flow simplified branching methodology
- Master Branch: production code
- Develop Branch: main integration branch for ongoing development. Features and fixes are merged into this branch before reaching master
- Feature Branch: created from develop branch to work on new features
Prerequisites
This project uses:
- Language: Python 3.10
- Libraries:
- pandas
- pytest
- assertpy
How to use it
Install the library
pip install data-quality-kit
from data_quality_quick.validate_formats import check_type_format
Functionalities
- df_is_empty: Check if a DataFrame is empty.
- check_nulls: Checks for null values in a specified column of a DataFrame.
- check_type_format: Check if all non-null entries in a specified column of a DataFrame are of the specified data type.
- check_no_duplicates: Checks for duplicate values in the specified primary key column of a DataFrame.
- check_column_match : Check if all values in column2 of df2 are present in column1 of df1.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
data_quality_kit-0.2.0.tar.gz
(8.3 kB
view hashes)
Built Distribution
Close
Hashes for data_quality_kit-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 60654f154ca7ea4f762f2c2e1ce59a4e41b9f01117e989398ccd919faf269b25 |
|
MD5 | 5d55242fb64754f53f7be291a62393e6 |
|
BLAKE2b-256 | 5ed0301725d591e47da2a8b8de920782a7b4792bc7f8afe4ca1237d246fdc6bd |