Skip to main content

tablevalidator-databricks

A widget-driven Databricks notebook UI for table-validator

  • generates a notebook with dbutils.widgets for picking source/target tables and validation checks, so you can run a comparison without writing any Python.

This package contains no validation logic of its own. It only writes a notebook file whose cells call directly into table-validator's own validate_tables() API - the exact same engine the CLI (tablevalidator) and the notebook-native Python API already use.

Install

pip install tablevalidator-databricks

Installing this package also installs table-validator (a dependency), so there's nothing else to install separately.

Usage

tablevalidator-databricks init

Writes ./TableValidator.py - a ready-to-use Databricks notebook. Options:

tablevalidator-databricks init --output MyValidation.py --mode full
  • --mode basic - only the check-group multiselect and table pickers.
  • --mode full (default) - also shows optional filter widgets (only/ ignore columns, row filter, primary key).
  • --mode schema - pre-selects only the "Catalog & Schema" check group, for a lightweight schema-shape-only comparison.

Then, in your Databricks workspace: Workspace -> Import, format "Source", and select the generated file. Databricks recognizes the # Databricks notebook source header and # COMMAND ---------- cell markers and opens it as a real notebook.

What the generated notebook does

  1. Installs table-validator (%pip install table-validator).
  2. Queries Unity Catalog (SHOW CATALOGS / SHOW SCHEMAS IN ... / SHOW TABLES IN ... via the notebook's own ambient Spark session) to populate Source/Target Catalog, Schema, and Table dropdowns.
  3. Shows a "Validation Checks" multiselect (Catalog & Schema / Column / Row - the three independently-selectable check groups the engine actually supports) plus, in full mode, optional text widgets for column filtering, a row filter, and a primary key.
  4. On run, reads every widget and calls validate_tables(source, target, enabled_validations=..., ...), then prints a summary and displays the Table Validation sheet.

Cascading dropdowns: Databricks widgets don't auto-refresh when an upstream selection changes. After changing Source/Target Catalog or Schema, re-run the notebook's "Create / refresh widgets" cell once to repopulate the dropdowns below it before running the rest of the notebook. This is a Databricks widget limitation, not a bug in the generated notebook. If you skip this and run validation anyway with a stale Schema/ Table selection, the notebook fails with a clear error telling you which cell to re-run, rather than silently comparing the wrong table.

Can't find a name in a dropdown? Every Catalog/Schema/Table dropdown has a matching "(manual override)" text widget next to it. Type the exact name there and it's used instead of the dropdown - useful if something isn't showing up (a permissions lag, sort order, anything). It's used as-is, not checked against the live catalog listing. Leave every override blank to just use the dropdowns as normal.

Why a separate package

table-validator stays focused on the actual comparison engine (CLI + notebook API + report generation). This package is purely a Databricks- specific UI layer on top of it - keeping the two independently versioned and installable means CLI-only or code-only users never need Databricks- specific tooling pulled in, and this package can add more Databricks UX (e.g. richer widgets) without touching the core engine at all.

Development

pip install -e ".[dev]"
pytest

License

MIT - see the table-validator repository's LICENSE.

Metadata

Release files for tablevalidator-databricks 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tablevalidator-databricks 0.1.1
File Size Uploaded Provenance Actions
tablevalidator_databricks-0.1.1.tar.gz 13.7 kB With provenance Details for tablevalidator_databricks-0.1.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for tablevalidator-databricks 0.1.1
File Interpreter ABI Platform Actions
tablevalidator_databricks-0.1.1-py3-none-any.whl Python 3 none any Details for tablevalidator_databricks-0.1.1-py3-none-any.whl

Total release size: 24.4 kB

Release files / tablevalidator_databricks-0.1.1.tar.gz

Download URL tablevalidator_databricks-0.1.1.tar.gz
Size 13.7 kB
Tags Source
SHA-256 checksum
How to use checksums
3f532aee6515fe928591629cdaab15b96c2311f5e60992fd87befc170b8a5872
BLAKE2b-256 checksum
How to use checksums
ac7731dd0fa6fde735877a7333daa73883dbe960a55ef3317fb4a3aff824620c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log

Release files / tablevalidator_databricks-0.1.1-py3-none-any.whl

Download URL tablevalidator_databricks-0.1.1-py3-none-any.whl
Size 10.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0c33fe3fcf457a010ea4a71c100f6cc3a6a9e0bccc3df78d7b76e46aee6864fb
BLAKE2b-256 checksum
How to use checksums
6e596567a30a8922a96ce15d73c042aa4bd80a1384ba518333097e1fa4aa9f89
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log

Security for tablevalidator-databricks 0.1.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for tablevalidator_databricks-0.1.1.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page