Provider package airflow-provider-sifflet for Apache Airflow
Project description
Sifflet Provider for Apache Airflow
This package provides operators and hook that integrate Sifflet into Apache Airflow.
All classes for this provider package are in the sifflet_provider
Python package.
Installation
You can install this package on top of an existing Airflow 2.1+ installation
pip install airflow-provider-sifflet
The package supports the following python versions: 3.7, 3.8, 3.9, 3.10
Configuration
In the Airflow user interface, configure a Connection for Sifflet. Configure the following fields:
Conn Id: sifflet_default
Conn Type: Sifflet
Sifflet Tenant: <Your tenant name>
Sifflet Token: <Your Sifflet access token>
Modules
Operators
SiffletDbtIngestOperator
SiffletDbtIngestOperator
sends your DBT artifacts to the Sifflet application.
Example usage:
from sifflet_provider.operators.dbt import SiffletDbtIngestOperator
sifflet_dbt_ingest = SiffletDbtIngestOperator(
task_id="sifflet_dbt_ingest",
input_folder="<path to dbt project folder>",
target="prod",
project_name="<dbt project name>",
)
SiffletRunRuleOperator
SiffletRunRuleOperator
Run one or several Sifflet rules - requires rule id(s).
Example usage:
from sifflet_provider.operators.rule import SiffletRunRuleOperator
sifflet_run_rule = SiffletRunRuleOperator(
task_id="sifflet_run_rule",
rule_ids=[
"3e2e2687-cd20-11ec-b38b-06bb20181849",
"3e19eb3e-cd20-11ec-b38b-06bb20181849",
"3e1a86f1-cd20-11ec-b38b-06bb20181849",
"3e2e1fc3-cd20-11ec-b38b-06bb20181849",
],
error_on_rule_fail=True
)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for airflow-provider-sifflet-1.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 45edbf18d7b300bbab45e5bec0a233d0a258dcbab5048cb643ba55253b04afc3 |
|
MD5 | 94542ee88d24aca241b6b408890bec7b |
|
BLAKE2b-256 | b6491dbb82d533f718482d498e1bca6748e3925650231803d2716a160b42ff46 |
Hashes for airflow_provider_sifflet-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ac96f4f378da151d90f71933229673aec3151ebf90619cc5a9dfe2b5c573f1a |
|
MD5 | dbd913918dc79b6ba8b43fe3329dfbef |
|
BLAKE2b-256 | c6b26b9f40ee0a4896014840e8dca8b1cc9764eaaf8f269c12c4deabebe6ff7c |