Skip to main content

Airflow operators to be used with Bigeye

Project description

bigeye-airflow

Airflow operators to interact with Bigeye API.

The Test Environment

Astronomer provides a local runtime for Airflow DAGs. This runtime is build from the Dockerfile in the astro folder. A startup bash script has been added, astro_dev, to facilitate the needed code copy into the astro environment.

Test environment is currently compatible with Python 3.6 and Airflow 1.10.7.

bash astro_dev start
bash astro_dev stop
bash astro_dev restart

Credentials Setup

  • Go to the Admin menu and choose Connections: Admin Menu - Connections

  • Fill out the form for an HTTP connection using the appropriate Host, User and Pass. The current test Dags use 'bigeye_connection' as a connection_id for basic auth to the Bigeye API. Admin Menu - Connections

Testing Metric Creation:

Testing in a DAG runtime can be achieved by altering the test dag: test_create_metrics_from_config_dag.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bigeye-airflow-0.0.16.tar.gz (9.2 kB view hashes)

Uploaded Source

Built Distribution

bigeye_airflow-0.0.16-py3-none-any.whl (13.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page