Airflow operators to be used with Bigeye. Supporting Airflow version 1.10.10.
Project description
bigeye-airflow
Airflow operators to interact with Bigeye API.
The Test Environment
Astronomer provides a local runtime for Airflow DAGs. This runtime is build from the Dockerfile in the astro folder. A startup bash script has been added, astro_dev, to facilitate the needed code copy into the astro environment.
Test environment is currently compatible with Python 3.6 and Airflow 1.10.7.
bash astro_dev start <-v 1>
bash astro_dev stop <-v 1>
bash astro_dev restart <-v 1>
Credentials Setup
-
Go to the Admin menu and choose Connections:
-
Fill out the form for an HTTP connection using the appropriate Host, User and Pass. The current test Dags use 'bigeye_connection' as a connection_id for basic auth to the Bigeye API.
Testing Metric Creation:
Testing in a DAG runtime can be achieved by altering the test dag: test_create_metrics_dag.py
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for bigeye_airflow1-0.0.21-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e48472ad64dd0f5934cc2670367f0b4d5402f0c08246b0c5c93710cd6ad7a2a2 |
|
MD5 | c4f5a808d4feb863e023b8bf43fc9293 |
|
BLAKE2b-256 | 3e5a8c6d8067f79aa416380603ade7da50f50601b60c19e5aedc9bc103a7148d |