Python Client for Apache CLI on AWS Managed Airflow
Project description
AWS MWAA (Managed Workflows for Apache Airflow) CLI - Python
Python Client for running Apache Airflow CLI commands on AWS MWAA (Managed Workflows for Apache Airflow) instances.
https://docs.aws.amazon.com/mwaa/latest/userguide/airflow-cli-command-reference.html
(currently) Supported Apache Airflow CLI commands
Version | Command | API |
---|---|---|
v2.2.2 | dags list | get_dags |
v2.0+ | dags pause | pause_dag |
v2.0+ | dags unpause | unpause_dag |
v2.0+ | dags show | show_dag |
v2.0+ | dags state | get_dag_state |
v2.0+ | dags trigger | new_dagrun |
v2.0+ | version | get_version |
Examples
Running CLI on a private VPC instance
Test locally using the following ssh tunnel configuration
ssh -D 8080 -C -N user@example.com
Create a client with proxy config session
from mwaah import MWAAH
cli = MWAAH(
'example-mwaa-environment',
boto3.client('mwaa'),
proxies={'https': 'socks5://0:8080'}
)
Setting up a new CLI session
Create a client passing in your own session
from mwaah import MWAAH
cli = MWAAH(
'example-mwaa-environment',
boto3.client('mwaa', region_name='example-region-1')
)
Get Version
print(cli.get_version())
2.2.2
Triggering a New DAG Run
date = datetime.now()
run = DAGRun()._from_openapi_data(
dag_id='example_dag_id',
execution_date=date,
dag_run_id="dag_run_id_example"+date.__str__(),
conf={'key': 'val'},
)
cli.new_dagrun(run)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mwaah-0.0.1.tar.gz
(4.5 kB
view hashes)
Built Distribution
mwaah-0.0.1-py3-none-any.whl
(4.7 kB
view hashes)