Skip to main content

Execute Blueprints Within the Quickpath Platform

Project description

Quickpath Airflow Operator

Allows from Execution of Blueprints on the Quickpath Platform from within Airflow

Installation

pip install quickpath-airflow-operator

Connections

Connections can be created as HTTP Type

Service Connection (QPP-Group)

Service Connection is Required for Blueprint Execution

Connection ID = `QPP-Group`
Connection Type = `HTTP`
Schema = `https`
Host = `<Quickpath_platform_base_url>`
Password = `<Group API Key>`

API Connection (QPP-User)

API Connection is only required if poll_for_results=True

Connection ID = `QPP-User`
Connection Type = `HTTP`
Schema = `https`
Host = `<Quickpath_platform_base_url>`
Password = `<User API Key>`

Usage

Import

from quickpath_airflow_operator import QuickpathPlatformOperator`

Syncronous Execution will execute a blueprint, wait for the result, and return it

quickpath_execution = QuickpathPlatformOperator(
    task_id="run_blueprint",
    service_connection_id="QPP-Group",
    api_connection_id="QPP-User",
    environment_name="design",
    blueprint_endpoint="blueprint_endpoint",
    request_object={},
    synchronous=True,
)

Produces XCom Keys blueprint_uuid and blueprint_response


Asyncronous Execution With Result Polling will execute a blueprint and poll for the blueprint resultsAsyncronous Execution will execute a blueprint and return the Blueprint UUID

quickpath_execution = QuickpathPlatformOperator(
    task_id="run_blueprint",
    service_connection_id="QPP-Group",
    api_connection_id="QPP-User",
    environment_name="design",
    blueprint_endpoint="blueprint_endpoint",
    request_object={},
    synchronous=False,
    poll_for_results=True,
    max_polls=20,
    poll_interval=5
)

Produces XCom Keys blueprint_uuid


Asyncronous Execution will execute a blueprint and return the Blueprint UUID

quickpath_execution = QuickpathPlatformOperator(
    task_id="run_blueprint",
    service_connection_id="QPP-Group",
    api_connection_id="QPP-User",
    environment_name="design",
    blueprint_endpoint="blueprint_endpoint",
    request_object={},
    synchronous=False,
    poll_for_results=True,
)

Produces XCom Keys blueprint_uuid and blueprint_response

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

quickpath-airflow-operator-1.0.2.tar.gz (4.7 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file quickpath-airflow-operator-1.0.2.tar.gz.

File metadata

File hashes

Hashes for quickpath-airflow-operator-1.0.2.tar.gz
Algorithm Hash digest
SHA256 c678424ee7f2802aacb281336ad78b2315f73f32307be99fdc3a3a8b1724a86b
MD5 e8ca7909f7a8df268d1b91fdbcc29b4f
BLAKE2b-256 d0dfa0954234d18c9903a6c1a8991a6702230ceb9a1e1b7221fa02b57a4a7de4

See more details on using hashes here.

File details

Details for the file quickpath_airflow_operator-1.0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for quickpath_airflow_operator-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 09967f8afd28c01c46856fbe8141e64dd42b14865c3b9a537861cfe0f441675e
MD5 f8d1b3a2bee56ebd4af80c94ff6f5c43
BLAKE2b-256 546f5a61a1cd52804e492de2dae368cde66b08438aceb81fcf11e152fa855eec

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page