Skip to main content

Data Quality Check Library

Project description

DATA QUALITY

A library which acts as a test cases for dataframes. Simply pass in your dataframe after initial import, or at each stage of your EDA to check for data quality with one line of code.

The test cases include(as of now)

  1. check for null values
  2. check for duplicates
  3. check for dtype matching
  4. check for outliers - depricated
  5. check for whitespaces in column headers - depricated

The test cases work as a Pass/Fail type, where Passed indicates, good data quality and Failed indicates bad data quality

Example:

TEST CASE FOR NULL VALUES: Passed means that the dataframe has no null values. Failed indicates otherwise.

Requirements

  • Python 3+
  • Pandas
  • Numpy

Installation

pip install data-quality-tests

Updates & Changes

  1. the import function changed from:
from data_quality import DataQuality

to the following:

from data_quality_tests import DataQuality
  1. new function get_row_count() has been added in this update, which displays number of rows in a dataframe.
    For use case, refer to the get started section

  2. data_quality_check now checks for column header whitespaces for leading and trailing.

Get Started

How to use this library:

Data quality check

The most basic usage of this library, here for simplifiction,
let's just se the iris dataset from seaborn library.

You can use any dataset.

from data_quality_tests import DataQuality as dq
import seaborn as sns

#declare any dataframe

df = sns.load_dataset("iris")

#pass the dataframe as below  

dq.data_quality_check(df)

dq.get_row_count(df)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_quality_tests-2.1.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_quality_tests-2.1-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file data_quality_tests-2.1.tar.gz.

File metadata

  • Download URL: data_quality_tests-2.1.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for data_quality_tests-2.1.tar.gz
Algorithm Hash digest
SHA256 e99f16a5ea4d93dbd8b2706a184ce4bf24e69ff0a95c29ddd190073361f111c6
MD5 e2ea3da84d47c9f086971bde6dc77818
BLAKE2b-256 013d245a770ad8c31c810f76d98fc802556885cc04954393c818f79931ecfa7a

See more details on using hashes here.

File details

Details for the file data_quality_tests-2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for data_quality_tests-2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 5cbc30d6b7286f5b90e27da6615b42d490b6aed07c8d5fafa1e9471eb7ab1856
MD5 c3720aa88bfed4503d1084cf9c9b6044
BLAKE2b-256 c34e171e3a16326ed097bdf2da291a6d63d93ebb18ec19eafa9b5b57c09bc4af

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page