Skip to main content

tablevalidator-databricks

A widget-driven Databricks notebook UI for table-validator

  • generates a notebook with dbutils.widgets for picking source/target tables and validation checks, so you can run a comparison without writing any Python.

This package contains no validation logic of its own. It only writes a notebook file whose cells call directly into table-validator's own validate_tables() API - the exact same engine the CLI (tablevalidator) and the notebook-native Python API already use.

Install

pip install tablevalidator-databricks

Installing this package also installs table-validator (a dependency), so there's nothing else to install separately.

Usage

tablevalidator-databricks init

Writes ./TableValidator.py - a ready-to-use Databricks notebook. Options:

tablevalidator-databricks init --output MyValidation.py --mode full
  • --mode basic - only the check-group multiselect and table pickers.
  • --mode full (default) - also shows optional filter widgets (only/ ignore columns, row filter, primary key).
  • --mode schema - pre-selects only the "Catalog & Schema" check group, for a lightweight schema-shape-only comparison.

Then, in your Databricks workspace: Workspace -> Import, format "Source", and select the generated file. Databricks recognizes the # Databricks notebook source header and # COMMAND ---------- cell markers and opens it as a real notebook.

What the generated notebook does

  1. Installs table-validator (%pip install table-validator).
  2. Queries Unity Catalog (SHOW CATALOGS / SHOW SCHEMAS IN ... / SHOW TABLES IN ... via the notebook's own ambient Spark session) to populate Source/Target Catalog, Schema, and Table dropdowns.
  3. Shows a "Validation Checks" multiselect (Catalog & Schema / Column / Row - the three independently-selectable check groups the engine actually supports) plus, in full mode, optional text widgets for column filtering, a row filter, and a primary key.
  4. On run, reads every widget and calls validate_tables(source, target, enabled_validations=..., ...), then prints a summary and displays the Table Validation sheet.

Cascading dropdowns: Databricks widgets don't auto-refresh when an upstream selection changes. After changing Source/Target Catalog or Schema, re-run the notebook's "Create widgets" cell once to repopulate the dropdowns below it before running the rest of the notebook. This is a Databricks widget limitation, not a bug in the generated notebook.

Why a separate package

table-validator stays focused on the actual comparison engine (CLI + notebook API + report generation). This package is purely a Databricks- specific UI layer on top of it - keeping the two independently versioned and installable means CLI-only or code-only users never need Databricks- specific tooling pulled in, and this package can add more Databricks UX (e.g. richer widgets) without touching the core engine at all.

Development

pip install -e ".[dev]"
pytest

License

MIT - see the table-validator repository's LICENSE.

Metadata

Release files for tablevalidator-databricks 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tablevalidator-databricks 0.1.0
File Size Uploaded Provenance Actions
tablevalidator_databricks-0.1.0.tar.gz 9.7 kB With provenance Details for tablevalidator_databricks-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for tablevalidator-databricks 0.1.0
File Interpreter ABI Platform Actions
tablevalidator_databricks-0.1.0-py3-none-any.whl Python 3 none any Details for tablevalidator_databricks-0.1.0-py3-none-any.whl

Total release size: 18.6 kB

Release files / tablevalidator_databricks-0.1.0.tar.gz

Download URL tablevalidator_databricks-0.1.0.tar.gz
Size 9.7 kB
Tags Source
SHA-256 checksum
How to use checksums
c33f9a66281dbb5455316b1d481e1c765327c00d01fd269dd0778e7fe1fcd4f1
BLAKE2b-256 checksum
How to use checksums
34f2b34f490fd5b07aca9cb17793f161d771f6087ead7890a41f086f5765e055
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log

Release files / tablevalidator_databricks-0.1.0-py3-none-any.whl

Download URL tablevalidator_databricks-0.1.0-py3-none-any.whl
Size 8.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0b52af7e78fb1214f51064fbbbd9a81c01293073e111c83ae0dae320070d0d41
BLAKE2b-256 checksum
How to use checksums
43d4246b0da99f699ebfb7b78755ff665fc677155752812b90d8dcee7472ca9f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log

Security for tablevalidator-databricks 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for tablevalidator_databricks-0.1.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page