Skip to main content

tff-core

Core architectural linter and fitness function engine for data transformation pipelines.

tff-core executes layer boundary validation, structural graph policies, schema contracts, and duplicate logic detection across dbt, SQLMesh, and Google Cloud Dataform projects.

Installation

Install tff-core with the adapter corresponding to your transformation engine:

# dbt adapter
pip install "tff-core[dbt]"

# SQLMesh adapter
pip install "tff-core[sqlmesh]"

# Dataform adapter
pip install "tff-core[dataform]"

# All adapters
pip install "tff-core[all]"

Architecture

Subsystem Function & Scope
AST & Semantic Parser Extracts AST nodes and semantic relationships using SQLGlot without database connections.
Check Registry Unified execution harness evaluating layer integrity, syntax bans, and duplicate CTEs.
Health Scoring Computes weighted quality metrics (0–100) and penalty distributions.
Adapter Interface Normalizes project manifests and configurations across pipeline engines.

Documentation

For CLI usage, configuration specifications, and rule authoring, refer to the main documentation and the tff repository.

Security & Trust Model

Trust model: tff dynamically loads and executes custom Python linter rules from your project's linter/ directory (in SQLMesh projects) or configured plugin paths, and reads filesystem paths declared in fitness_functions.yaml and related JSON files (such as schema contract groups or exclusion files).

Run tff only against repositories you trust, the same as you would run sqlmesh plan, dbt compile, or make test. Do not run tff check or tff lint on untrusted repositories without first reviewing project Python scripts and configuration files.

License

Distributed under the MIT License.

Metadata

Release files for tff-core 0.30.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tff-core 0.30.0
File Size Uploaded Provenance Actions
tff_core-0.30.0.tar.gz 664.3 kB With provenance Details for tff_core-0.30.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for tff-core 0.30.0
File Interpreter ABI Platform Actions
tff_core-0.30.0-py3-none-any.whl Python 3 none any Details for tff_core-0.30.0-py3-none-any.whl

Total release size: 1.2 MB

Release files / tff_core-0.30.0.tar.gz

Download URL tff_core-0.30.0.tar.gz
Size 664.3 kB
Tags Source
SHA-256 checksum
How to use checksums
b50ef3216015de6fef2bf20b46a2b4e8eafc705088376912382a97544df16df3
BLAKE2b-256 checksum
How to use checksums
5236a9fab771bf2aa644fcbacefdb1c857a1b7f75a14a567195f076e2f9f93fc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

Release files / tff_core-0.30.0-py3-none-any.whl

Download URL tff_core-0.30.0-py3-none-any.whl
Size 534.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
4ee46217619e57177bcbe5a56315796d5bb47460af13e04d6577444f0f7e7c53
BLAKE2b-256 checksum
How to use checksums
e7afc62354b755ce17c32b87ddf28fa82b724f6eb57676ae58f476693e2939e0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

Security for tff-core 0.30.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for tff_core-0.30.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.30.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page