bills-sql-lineage 0.0.1

Personal SQL lineage generator.

---

SQL Lineage 🔀

Personal SQL lineage generator.

Built on the following awesome libraries:

• SQLGlot for SQL parsing
• arguably for the CLI

So... what is this? 🤔

[!NOTE]

This project is still in development and currently only parses the CTEs of an SQL query since that's all I need for now.

I write a lot of SQL, and I often need to understand "lineage" in lots of different ways.

Things like dbt and SQLMesh are great for object lineage (tables, columns, etc.), but I often need to understand "lineage" like the CTE lineage in a query, among other things.

This project is just a personal tool to help me generate lineage diagrams (in Mermaid syntax) for SQL queries to fit that requirement.

Upcoming improvements will (hopefully) include:

• Column lineage to Mermaid
• Semantic edges (e.g. distinguish between JOIN, WHERE, UNION, etc.)
• Lineage for multiple files in a single diagram

Installation ⬇️

Grab a copy from PyPI like usual (note the bills- prefix):

pip install bills-sql-lineage

Usage 📖

Pass the path to a SQL file to the lineage command to generate the lineage as a Mermaid diagram:

lineage path/to/file.sql

This will write a Mermaid diagram to path/to/file.mermaid. You can control the target with the second argument:

lineage path/to/file.sql path/to/output.mermaid