Skip to main content

[interrogate]

qprofiler

qprofiler is a Python package that provides an intelligent way to create a data quality profile for your development(train) dataset(s) and save it as a reference to use in creating quality check tests and automatic handling cases for production(test) datasets.

Table of Contents

Installation

The source code is currently hosted on GitHub at: dprofiler-github

Binary installers for the latest released version are available at the PyPi

# PyPi
pip install qprofiler

Dependencies

  • Polars(>=0.19.0 <0.20.0)
  • PyYAML(>=6.0.1 <7.0.0)
  • Pathlib(>=1.0 <2.0)
  • rumamel.yaml(>=0.17.32 <0.18.0)

Usage

check the notebook that contains everything about how to use DataProfiler module in profiling datasets, and how to use QTest module to create quality check tests.

check the notebook that contains everything about how to use QPipeline

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.

Licence

MIT

New in v0.2.3

  • Create Quality Pipeline(v0.2.2).
  • enhance documentation.
  • add utility method in DataProfiler to .dprofiler structure tree.

New in v0.3.0

  • Modify file structure of .dprofiler.
  • add Metadata Module of .dprofiler.
  • modify test cases.

Metadata

Release files for qprofiler 0.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for qprofiler 0.3.0
File Size Uploaded Provenance Actions
qprofiler-0.3.0.tar.gz 15.8 kB Without provenance Details for qprofiler-0.3.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for qprofiler 0.3.0
File Interpreter ABI Platform Actions
qprofiler-0.3.0-py3-none-any.whl Python 3 none any Details for qprofiler-0.3.0-py3-none-any.whl

Total release size: 34.8 kB

Release files / qprofiler-0.3.0.tar.gz

Download URL qprofiler-0.3.0.tar.gz
Size 15.8 kB
Tags Source
SHA-256 checksum
How to use checksums
9c81a1455617e7201af6e6f28d9f3e1221eab1bfed1051703115f38d530be6db
BLAKE2b-256 checksum
How to use checksums
b8368b966120492b68a3545c0d39d6e050530ee0b4620200931154a690c597c9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.6.1 CPython/3.10.13 Linux/6.2.0-1011-azure

Release files / qprofiler-0.3.0-py3-none-any.whl

Download URL qprofiler-0.3.0-py3-none-any.whl
Size 18.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
cb7c7eacf5ad7cb84aa3547738f0c65332512ecfad4aa4b4ed3ce4ddac617ce8
BLAKE2b-256 checksum
How to use checksums
d333eb13281565f62de21cf612dd6d9333f396f3872e1983789ed787ea02c423
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.6.1 CPython/3.10.13 Linux/6.2.0-1011-azure

Security for qprofiler 0.3.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page