An Airflow plugin for interacting with IOMETE platform.
Project description
IOMETE Airflow Plugin
This Plugin helps to trigger/run Spark Jobs created in IOMETE platform.
Installation
This plugin could be easily installed with pip
. Just run the following in your aiflow server:
pip install iomete-airflow-plugin
Restart you server and check the plugins page on Airflow's admin panel to make sure plugin loaded successfully.
Configuration
You need to add iomete_access_token
key to airflow's Variables module.
Check our documentation page on how to generate personal access token.
Usage
Here are sample DAG:
from airflow import DAG
from iomete_airflow_plugin.iomete_operator import IometeOperator
dag = DAG(dag_id="...", default_args={}, schedule_interval=None)
task = IometeOperator(
task_id="random_task_id",
job_id="1b0fc29b-5491-4c0a-94ea-48e304c3c72e", # Spark Job ID or Name in IOMETE platform.
workspace_id="pceh7-816", # Your workspace ID in IOMETE platform
dag=dag,
)
Resources
For more information check:
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for iomete_airflow_plugin-1.0.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | d8eda8f9296e72392ac883bdb3f0a5a0b1ce6ef8fbfd08137cacf6fc34e9e994 |
|
MD5 | a97adc94d89bc0284a7da0e8a963fda0 |
|
BLAKE2b-256 | 2778edd2bfee75088f9ed6ef8a834f6de318895327bc96a74d6aca6c80b22817 |
Close
Hashes for iomete_airflow_plugin-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1b020eaab7e540bb2c383842eb206644ad9db46b26545f38692a896798d7981e |
|
MD5 | 2d575a0d0136fda2a0c6d0e17ca742a1 |
|
BLAKE2b-256 | ebb6f4a4b22861a399ebc010a9c447bc921a17b9a4fef854065bbb788604508d |