library of functions for managing and improving data quality in Datasets
Project description
Data-Quality-Kit
Functional Description
A library of functions for managing and improving data quality in Datasets
Owner
For any bugs or questions, please reach out to Dante Pedrozo
Branching Methodology
This project follows a Git Flow simplified branching methodology
- Master Branch: production code
- Develop Branch: main integration branch for ongoing development. Features and fixes are merged into this branch before reaching master
- Feature Branch: created from develop branch to work on new features
Prerequisites
This project uses:
- Language: Python 3.10
- Libraries:
- pandas
- pytest
- assertpy
How to use it
Install the library
pip install data-quality-kit
from data_quality_quick.validate_formats import check_type_format
Functionalities
- Completeness
- assert_that_dataframe_is_empty: Check if a DataFrame is empty.
- check_nulls: Checks for null values in a specified column of a DataFrame.
- check_type_format: Check if all non-null entries in a specified column of a DataFrame are of the specified data type.
- check_no_duplicates: Checks for duplicate values in the specified primary key column of a DataFrame.
- check_column_match : Check if all values in column2 of df2 are present in column1 of df1.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
data_quality_kit-0.3.0.tar.gz
(8.4 kB
view hashes)
Built Distribution
Close
Hashes for data_quality_kit-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2d4cf35b91db5c3b9963336405a07e8591efcf13e240326235c16a6ecae03807 |
|
MD5 | 6e5315d8125bd5db642ffc582245c76b |
|
BLAKE2b-256 | 51acd4e2fdd7cfde3493cd5abbaad81cc25850ca9736d7990d5998d30d6cbc8c |