Skip to main content

Data questioning, observability, semantic, and causality library

Project description

dqtlib

A Data Questioning Tool that tells you the what and surfaces the why.

Unifies your scattered data into one source of truth. Upgrades your existing models, dashboards, and queries into a causal semantic layer you didn't have to write. Picks up on trends and surfaces business insights, all wrapped in a quality harness that puts guardrails on the AI so the reports it generates stay on-spec.

pip install dqtlib

The import name is dqt:

from dqt import Check, Runner, MemoryStore

Full documentation and examples: https://github.com/antonbarr-data/dqt

Quality

All 64 detectors are benchmarked against labeled synthetic datasets. Benchmark scripts and raw results live in the GitHub repo and are run on every release:

Median F1: 1.00 | Detectors with F1 >= 0.8: 52/64 | Detectors with F1 >= 0.6: 58/64

Per-detector breakdown: examples/benchmarks/results_summary.md

Reproduce by cloning the repo and running:

python scripts/run_benchmark_suite.py --quick
python scripts/generate_benchmark_summary.py

Adapters

Six adapters ship in v1.0. Nightly CI runs against live credentials for the cloud warehouses.

Adapter CI
PostgreSQL (local) bundled — no credentials needed
ClickHouse clickhouse
Snowflake snowflake
BigQuery bigquery
Databricks databricks
Local (DuckDB) bundled — no credentials needed

Detector documentation

64 statistical detectors across 10 groups — drift, outliers, time series, distribution, information theory, pattern, referential, schema, basic, and custom.

Every detector has a structured page at docs/algorithms/<group>/<slug>.md covering:

  • What it computes and its parameters
  • When it works well and when it fails (with concrete failure-mode table)
  • Default-threshold calibration — empirical FPR across six canonical data shapes (Normal, Lognormal, Poisson, Beta, Pareto, Exponential)
  • Recommended thresholds per data shape
  • Canonical citation and runnable Python API example

Browse the full catalog: docs/algorithms/README.md

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dqtlib-1.4.1.tar.gz (312.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dqtlib-1.4.1-py3-none-any.whl (342.5 kB view details)

Uploaded Python 3

File details

Details for the file dqtlib-1.4.1.tar.gz.

File metadata

  • Download URL: dqtlib-1.4.1.tar.gz
  • Upload date:
  • Size: 312.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.11 {"installer":{"name":"uv","version":"0.11.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for dqtlib-1.4.1.tar.gz
Algorithm Hash digest
SHA256 d9fcdbec69b43cb510618ba8f9383ee911cd02314ed47c45367cdc45e9ae50fc
MD5 a47866c4b269564f4716e852a4ace095
BLAKE2b-256 d5effe38b38fcecf1e8337e0c1fd2faa31d28b4482d475969b25913581a60155

See more details on using hashes here.

File details

Details for the file dqtlib-1.4.1-py3-none-any.whl.

File metadata

  • Download URL: dqtlib-1.4.1-py3-none-any.whl
  • Upload date:
  • Size: 342.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.11 {"installer":{"name":"uv","version":"0.11.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for dqtlib-1.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b005f575bdd0b3cdade2fcf794b98568db26145c9eab2761f4bf16f132e58d26
MD5 3dd8f2b10cd6cee8ace1a2522bb34589
BLAKE2b-256 da45b72a41c50ec755661531e2dbb792834341a25ab83b705b82106da863a0fa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page