Library extracting source and destination tables from sql statements
Project description
OpenLineage SQL Parser
Library that extracts lineage from sql statements.
Usage
If you're using OpenLineage integration, there's good chance that you're already using this integration.
This library can be used both as Python library and as Rust library, however it's not published at Cargo yet.
Installation
Python:
$ pip install openlineage-sql
To install from source, you need to have Rust toolchain.
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
You can run cargo tests then:
cargo test
To build Python wheel for your system and architecture you need Maturin build system. It's recommended to install this in virtualenv.
python -m pip install maturin
maturin build --out target/wheels
You can verify that library has been properly build by running
pip install openlineage-sql --no-index --find-links target/wheels --force-reinstall
python -c "import openlineage_sql"
Todo:
- Support larger part of SQL language
- Column-level lineage
- Python as a cargo feature
- Explore Java integration
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
openlineage_sql-0.10.0.tar.gz
(16.7 kB
view hashes)
Built Distributions
Close
Hashes for openlineage_sql-0.10.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 418618ece941d5766b60b893208565ceecde5b44b8e46c3434142f1c554e8f3e |
|
MD5 | d5d9b9faf9c2aa539b4f5f4612ea152d |
|
BLAKE2b-256 | c870b33d53b85a108fd44f980861e3a22d65d2823f52c2950d0ae89892a95bd9 |
Close
Hashes for openlineage_sql-0.10.0-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fd461238630b399ca51928e36294e5fa4f8e6780fa36d029d6663aac0997aba8 |
|
MD5 | b00c72af2d90720a31d9f5283e80d24c |
|
BLAKE2b-256 | e6810075168655d70aa4fbc69cfd42979db1faa62c0ebfcd87f4392d5f5a8f62 |
Close
Hashes for openlineage_sql-0.10.0-cp37-abi3-manylinux_2_5_i686.manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc57e7d23364fb4e7203660c5e53d6919ec5f48384ab73c8595a8f47b3c68ae5 |
|
MD5 | 8bbac0bc16b1b10a6776ff8990fe653f |
|
BLAKE2b-256 | 2fc2dd687072029fe230f3c058668506d0c507c4ea220628ec9383f1330655f1 |