bigeye-airflow 0.1.1

Airflow operators to be used with Bigeye

bigeye-airflow

Airflow operators to interact with Bigeye API.

The Test Environment

Astronomer provides a local runtime for Airflow DAGs. This runtime is build from the Dockerfile in the astro folder. A startup bash script has been added, astro_dev, to facilitate the needed code copy into the astro environment.

Test environment is currently compatible with Python 3.6 and Airflow 1.10.7.

bash astro_dev start <-v 1>
bash astro_dev stop <-v 1>
bash astro_dev restart <-v 1>

Credentials Setup

• Go to the Admin menu and choose Connections:

• Fill out the form for an HTTP connection using the appropriate Host, User and Pass. The current test Dags use 'bigeye_connection' as a connection_id for basic auth to the Bigeye API.

Testing Metric Creation:

Testing in a DAG runtime can be achieved by altering the test dag: test_create_metrics_dag.py