Skip to main content

A tool to check data quality against predefined standards and generated data standards if needed.

Project description

Data Quality Tool

Overview

The Data Quality Tool is designed to help you check and ensure the quality of your data by comparing it against defined standards. It can also generate a data value standard file based on manual input or from a CSV data file.

Features

  • Check and Export Data Quality Log:
    • Checks for missing variables
    • Checks for value mismatches based on defined standards
  • Generate Data Value Standard File:
    • Generate from manual input
    • Generate from an existing CSV data file

Installation

To install this package, ensure you have pip version 24:

# Upgrade pip to version 24
pip install --upgrade pip==24

Then install the package:

pip install data-standards-check

Usage

  1. Put your all the data in one folder
  2. Run the tool in sh
  3. The analysis log will be automatically generated under the new data folder
# Check data quality and export log
data_check --check <data_folder_path>

# Generate data value standard file
data_check --generate <data_folder> [--input_file <input_file>]

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_standards_check-0.2.tar.gz (13.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_standards_check-0.2-py3-none-any.whl (13.4 kB view details)

Uploaded Python 3

File details

Details for the file data_standards_check-0.2.tar.gz.

File metadata

  • Download URL: data_standards_check-0.2.tar.gz
  • Upload date:
  • Size: 13.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for data_standards_check-0.2.tar.gz
Algorithm Hash digest
SHA256 f385b5f37af23e9370f5dd036186a55da3677491de72864a01417d1f2704f4d0
MD5 babb2ce2f23b3c5159bd60ba1a4a4e24
BLAKE2b-256 036fabfcc3e63e166709d659d44c937afe55b3a3e453f2c15a12800b4385b7f2

See more details on using hashes here.

File details

Details for the file data_standards_check-0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for data_standards_check-0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 3b8d847e981a497cea2561738d63597b6fc6b49320c2a074615a5bcf8036ce1d
MD5 e5b4a35a9daa378ab9bab0a7d5af11fb
BLAKE2b-256 48f4754881f1e4fe5e74b935665c23dbd6a55bec4f3864b65fd104b02cfb000f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page