Execute Blueprints Within the Quickpath Platform
Project description
Quickpath Airflow Operator
Allows from Execution of Blueprints on the Quickpath Platform from within Airflow
Installation
pip install quickpath-airflow-operator
Connections
Connections can be created as HTTP
Type
Service Connection (QPP-Group)
Service Connection is Required for Blueprint Execution
Connection ID = `QPP-Group`
Connection Type = `HTTP`
Schema = `https`
Host = `<Quickpath_platform_base_url>`
Password = `<Group API Key>`
API Connection (QPP-User)
API Connection is only required if poll_for_results=True
Connection ID = `QPP-User`
Connection Type = `HTTP`
Schema = `https`
Host = `<Quickpath_platform_base_url>`
Password = `<User API Key>`
Usage
Import
from quickpath_airflow_operator import QuickpathPlatformOperator`
Syncronous Execution will execute a blueprint, wait for the result, and return it
quickpath_execution = QuickpathPlatformOperator(
task_id="run_blueprint",
service_connection_id="QPP-Group",
api_connection_id="QPP-User",
environment_name="design",
blueprint_endpoint="blueprint_endpoint",
request_object={},
synchronous=True,
)
Produces XCom Keys blueprint_uuid
and blueprint_response
Asyncronous Execution With Result Polling will execute a blueprint and poll for the blueprint resultsAsyncronous Execution will execute a blueprint and return the Blueprint UUID
quickpath_execution = QuickpathPlatformOperator(
task_id="run_blueprint",
service_connection_id="QPP-Group",
api_connection_id="QPP-User",
environment_name="design",
blueprint_endpoint="blueprint_endpoint",
request_object={},
synchronous=False,
poll_for_results=True,
max_polls=20,
poll_interval=5
)
Produces XCom Keys blueprint_uuid
Asyncronous Execution will execute a blueprint and return the Blueprint UUID
quickpath_execution = QuickpathPlatformOperator(
task_id="run_blueprint",
service_connection_id="QPP-Group",
api_connection_id="QPP-User",
environment_name="design",
blueprint_endpoint="blueprint_endpoint",
request_object={},
synchronous=False,
poll_for_results=True,
)
Produces XCom Keys blueprint_uuid
and blueprint_response
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for quickpath-airflow-operator-1.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | c678424ee7f2802aacb281336ad78b2315f73f32307be99fdc3a3a8b1724a86b |
|
MD5 | e8ca7909f7a8df268d1b91fdbcc29b4f |
|
BLAKE2b-256 | d0dfa0954234d18c9903a6c1a8991a6702230ceb9a1e1b7221fa02b57a4a7de4 |
Close
Hashes for quickpath_airflow_operator-1.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 09967f8afd28c01c46856fbe8141e64dd42b14865c3b9a537861cfe0f441675e |
|
MD5 | f8d1b3a2bee56ebd4af80c94ff6f5c43 |
|
BLAKE2b-256 | 546f5a61a1cd52804e492de2dae368cde66b08438aceb81fcf11e152fa855eec |