Automate data quality checks before and after ETL into a database.
Project description
The Shard Data Quality Check Package
The Shard Data Quality Check Package is a package to help automate data quality checks for a database before and after ETL and Injection into a database.
Features
- Detect duplicates
- Identify missing values
- Compute five-number summary
- Validate schema using Pandera. Validation include checking if
- Values are greater, less, great than or equal to, less than or equal to a specified value
- If dates are before, after, before or on, after or on and between specified dates.
- The min and max length
- If there are nulls
- if a specified value is in a specified list.
Install
$ pip install data_quality_checks_the_shard
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file data_quality_checks_the_shard-0.0.3.tar.gz.
File metadata
- Download URL: data_quality_checks_the_shard-0.0.3.tar.gz
- Upload date:
- Size: 5.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8d12a1312aab91dae81a75b8c03b70140a3d120e64e0ccf582937ce25700c009
|
|
| MD5 |
dc9cfbdb4b0054db402ff7b0cf2f2773
|
|
| BLAKE2b-256 |
e0e7c2cd6e6c8bf5238b44b5ed7ec65a4e221120cde288892671569801c2118a
|
File details
Details for the file data_quality_checks_the_shard-0.0.3-py3-none-any.whl.
File metadata
- Download URL: data_quality_checks_the_shard-0.0.3-py3-none-any.whl
- Upload date:
- Size: 8.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d35c8250715d3481e63140560999a38753573c9c8db71417d3326a5eff30d093
|
|
| MD5 |
8ca3f5667b8a606033218fa944f37cfe
|
|
| BLAKE2b-256 |
1c010819a25afcc773ea75f2f70fbbc9a4b03ad6c42e809bfcd097a9ad9c8f49
|
