Skip to main content

dataqual

CLI tool for auditing CSV/Excel/PostgreSQL datasets — detects missing values, duplicates, type mismatches, and outliers.

Install

pip install -e .

Check a dataset

Basic CSV check (Rich terminal report):

dataqual check --file data.csv

Export the report as a self-contained HTML page or JSON file (written to <name>_report.html / <name>_report.json):

dataqual check --file data.csv --report html
dataqual check --file data.csv --report json

Detect duplicates by key column(s) instead of full-row equality (rows with null keys are skipped, not treated as matching):

dataqual check --file data.csv --keys email
dataqual check --file data.csv --keys "email,phone"

Override alert thresholds with a YAML config (see dataqual.config.yaml for a commented example):

dataqual check --file data.csv --config dataqual.config.yaml

Load from Excel — --sheet takes a name or zero-based index, default first sheet:

dataqual check --file data.xlsx
dataqual check --file data.xlsx --sheet inventory

Check a PostgreSQL table or query

Use --db-url instead of --file, plus exactly one of --table or --query:

dataqual check --db-url postgresql://user:pass@host:5432/db --table public.users
dataqual check --db-url postgresql://user:pass@host:5432/db --query "SELECT * FROM users WHERE active"

Compare two datasets

Diff two files (CSV or Excel) — rows added, removed, and changed, with old/new values per column. --keys identifies "the same row" across both files and is strongly recommended; without it rows are matched by position:

dataqual compare --file1 old.csv --file2 new.csv --keys id

Development

pip install -e ".[dev]"
pytest
ruff check .

Metadata

Release files for dataqual 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dataqual 0.1.0
File Size Uploaded Provenance Actions
dataqual-0.1.0.tar.gz 21.5 kB Without provenance Details for dataqual-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for dataqual 0.1.0
File Interpreter ABI Platform Actions
dataqual-0.1.0-py3-none-any.whl Python 3 none any Details for dataqual-0.1.0-py3-none-any.whl

Total release size: 41.5 kB

Release files / dataqual-0.1.0.tar.gz

Download URL dataqual-0.1.0.tar.gz
Size 21.5 kB
Tags Source
SHA-256 checksum
How to use checksums
aa3a4724b1ccd8061dd3e8dd2025a696ae9868bd187940e327ea33be081a22e2
BLAKE2b-256 checksum
How to use checksums
8374783531f6d8b9f8647ae847ec4fb5fe0d6d395eec4beb4fc0be33299e2be9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.0

Release files / dataqual-0.1.0-py3-none-any.whl

Download URL dataqual-0.1.0-py3-none-any.whl
Size 20.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fc783297d881f67cbef0a2c9cdb5f97690f51474367123227741e5d7b1007c95
BLAKE2b-256 checksum
How to use checksums
2f9906d6a1430e60a93a9b79a0c179f649133c915a33d1b3a6eb6503455880dc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.0

Security for dataqual 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page