Skip to main content

Airflow plugin to export dag and task based metrics to Prometheus.

Project description

Airflow prometheus exporter

travis build status

Exposes dag and task based metrics from Airflow to a Prometheus compatible endpoint.

Screenshots

Compatibility

Note: this version is compatible with Airflow 1.10.3+ only, see #46 for details

For compatibility with previous versions of Airflow use older version: v0.5.4

  • Airflow: airflow1.10.3+
  • Python: python2, python3
  • DataBase: postgresql, mysql

Install

pip install airflow-exporter

That's it. You're done.

Metrics

Metrics will be available at

http://<your_airflow_host_and_port>/admin/metrics/

airflow_task_status

Labels:

  • dag_id
  • task_id
  • owner
  • status

Value: number of tasks in specific status.

airflow_dag_status

Labels:

  • dag_id
  • owner
  • status

Value: number of dags in specific status.

airflow_dag_run_duration

Labels:

  • dag_id: unique identifier for a given DAG

Value: duration in seconds of the longest DAG Run for given DAG. This metric is not available for DAGs that have already completed.

License

Distributed under the BSD license. See LICENSE for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

airflow-exporter-1.1.0.tar.gz (3.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

airflow_exporter-1.1.0-py2.py3-none-any.whl (5.4 kB view details)

Uploaded Python 2Python 3

File details

Details for the file airflow-exporter-1.1.0.tar.gz.

File metadata

  • Download URL: airflow-exporter-1.1.0.tar.gz
  • Upload date:
  • Size: 3.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.1.0 requests-toolbelt/0.9.1 tqdm/4.34.0 CPython/3.7.4

File hashes

Hashes for airflow-exporter-1.1.0.tar.gz
Algorithm Hash digest
SHA256 fbe028160494fa962edc709feacf0bd4b52ee6f96c6fcb32278d04ea4bde9c5e
MD5 ef8603621e4c9045d768fa56d651c464
BLAKE2b-256 bc21406cd73e965737956542d069985bb4011d2023b889a2f7f9397529142e4e

See more details on using hashes here.

File details

Details for the file airflow_exporter-1.1.0-py2.py3-none-any.whl.

File metadata

  • Download URL: airflow_exporter-1.1.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.1.0 requests-toolbelt/0.9.1 tqdm/4.34.0 CPython/3.7.4

File hashes

Hashes for airflow_exporter-1.1.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 b0fd1b0effdb7949e7bfaa6d1e190d8407b3d8da4b1d948d4d8c123540f95478
MD5 d514872a91b60460d6fc804b61205b5a
BLAKE2b-256 779578f3d7387b29acfcb3ffabb9d4498745ed96348df6b5ab25a08c25834952

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page