Execute Blueprints Within the Quickpath Platform
Project description
Quickpath Airflow Operator
Allows from Execution of Blueprints on the Quickpath Platform from within Airflow
Installation
pip install quickpath-airflow-operator
Connections
Connections can be created as HTTP
Type
Service Connection (QPP-Group)
Service Connection is Required for Blueprint Execution
Connection ID = `QPP-Group`
Connection Type = `HTTP`
Schema = `https`
Host = `<Quickpath_platform_base_url>`
Password = `<Group API Key>`
API Connection (QPP-User)
API Connection is only required if poll_for_results=True
Connection ID = `QPP-User`
Connection Type = `HTTP`
Schema = `https`
Host = `<Quickpath_platform_base_url>`
Password = `<User API Key>`
Usage
Import
from quickpath_airflow_operator import QuickpathPlatformOperator`
Syncronous Execution will execute a blueprint, wait for the result, and return it
quickpath_execution = QuickpathPlatformOperator(
task_id="run_blueprint",
service_connection_id="QPP-Group",
api_connection_id="QPP-User",
environment_name="design",
blueprint_endpoint="blueprint_endpoint",
request_object={},
synchronous=True,
)
Produces XCom Keys blueprint_uuid
and blueprint_response
Asyncronous Execution With Result Polling will execute a blueprint and poll for the blueprint resultsAsyncronous Execution will execute a blueprint and return the Blueprint UUID
quickpath_execution = QuickpathPlatformOperator(
task_id="run_blueprint",
service_connection_id="QPP-Group",
api_connection_id="QPP-User",
environment_name="design",
blueprint_endpoint="blueprint_endpoint",
request_object={},
synchronous=False,
poll_for_results=True,
max_polls=20,
poll_interval=5
)
Produces XCom Keys blueprint_uuid
Asyncronous Execution will execute a blueprint and return the Blueprint UUID
quickpath_execution = QuickpathPlatformOperator(
task_id="run_blueprint",
service_connection_id="QPP-Group",
api_connection_id="QPP-User",
environment_name="design",
blueprint_endpoint="blueprint_endpoint",
request_object={},
synchronous=False,
poll_for_results=True,
)
Produces XCom Keys blueprint_uuid
and blueprint_response
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file quickpath-airflow-operator-1.0.2.tar.gz
.
File metadata
- Download URL: quickpath-airflow-operator-1.0.2.tar.gz
- Upload date:
- Size: 4.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c678424ee7f2802aacb281336ad78b2315f73f32307be99fdc3a3a8b1724a86b |
|
MD5 | e8ca7909f7a8df268d1b91fdbcc29b4f |
|
BLAKE2b-256 | d0dfa0954234d18c9903a6c1a8991a6702230ceb9a1e1b7221fa02b57a4a7de4 |
File details
Details for the file quickpath_airflow_operator-1.0.2-py3-none-any.whl
.
File metadata
- Download URL: quickpath_airflow_operator-1.0.2-py3-none-any.whl
- Upload date:
- Size: 6.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 09967f8afd28c01c46856fbe8141e64dd42b14865c3b9a537861cfe0f441675e |
|
MD5 | f8d1b3a2bee56ebd4af80c94ff6f5c43 |
|
BLAKE2b-256 | 546f5a61a1cd52804e492de2dae368cde66b08438aceb81fcf11e152fa855eec |