profile tabular datasets, manage automatic validation for new datasets, automatic handling for quality issues.
Project description
qprofiler
qprofiler is a Python package that provides an intelligent way to create a data quality profile for your development(train) dataset(s) and save it as a reference to use in creating quality check tests and automatic handling cases for production(test) datasets.
Table of Contents
Installation
The source code is currently hosted on GitHub at: dprofiler-github
Binary installers for the latest released version are available at the PyPi
# PyPi
pip install qprofiler
Dependencies
- Polars(>=0.19.0 <0.20.0)
- PyYAML(>=6.0.1 <7.0.0)
- Pathlib(>=1.0 <2.0)
- rumamel.yaml(>=0.17.32 <0.18.0)
Usage
check the notebook that contains everything about how to use DataProfiler module in profiling datasets, and how to use QTest module to create quality check tests.
Contributing
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.
Licence
New in v0.2.1
- Bug Fixes in QTest.
- Return Messages From Quality Check Tests.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for qprofiler-0.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 094915f163dd727da9dad8e5aa351b072ad71d27c4a55ef0634eee48a61d63fe |
|
MD5 | 92af3d21bd1c5d310055dcac5e2c78e3 |
|
BLAKE2b-256 | f8810b541b4b36d2e487d48e1364d8d7049946970d7ee2267b079558d905f825 |