Skip to main content

An Airflow plugin to launch and monitor Spark applications on the Data Mechanics platform

Project description

Data Mechanics Airflow Plugin

An Airflow plugin to launch and monitor Spark applications on the Data Mechanics platform.

Environment

  • Python >= 3.5
  • apache-airflow >= 1.10.x

Installation and usage

A tutorial to configure and use this plugin is available in the Data Mechanics docs.

Example DAGs

You can see example DAGs in here.

Changelog

1.0.7 2020-09-11

Changed

  • Changed bumversion config

1.0.6 2020-09-11

Changed

  • Updated doc

1.0.5 2020-09-11

Fixed

  • Dependency management

1.0.0 2020-09-11

Changed

  • Converted the existing plugin into a Python package

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datamechanics_airflow_plugin-1.0.7.tar.gz (5.7 kB view details)

Uploaded Source

Built Distribution

datamechanics_airflow_plugin-1.0.7-py2.py3-none-any.whl (7.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file datamechanics_airflow_plugin-1.0.7.tar.gz.

File metadata

  • Download URL: datamechanics_airflow_plugin-1.0.7.tar.gz
  • Upload date:
  • Size: 5.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.6

File hashes

Hashes for datamechanics_airflow_plugin-1.0.7.tar.gz
Algorithm Hash digest
SHA256 652d5b27b0d0c6b19b479d68b3ab56304cbbe39d0e42304ab79a87c251c96749
MD5 e7ae34d202bbeb76684ba1f2286491d7
BLAKE2b-256 1bfbe3c9f5a50b617b48ea4a54599bc15da9a2b9ab25aff03f1799e0ca96297d

See more details on using hashes here.

File details

Details for the file datamechanics_airflow_plugin-1.0.7-py2.py3-none-any.whl.

File metadata

  • Download URL: datamechanics_airflow_plugin-1.0.7-py2.py3-none-any.whl
  • Upload date:
  • Size: 7.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.6

File hashes

Hashes for datamechanics_airflow_plugin-1.0.7-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 554f8f5c16ebea6192da849b8aa5fd6285aa8ce0fb38c703eef9ff6d3380f435
MD5 7add39259dfe7a73fa0415266bae6a6d
BLAKE2b-256 a5935b7276feaf2e0ed5f2af8d6d333e752ad8a4d14be8117bf1dc6f6018b5b8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page