An Airflow plugin to launch and monitor Spark applications on the Data Mechanics platform
Project description
Data Mechanics Airflow Plugin
An Airflow plugin to launch and monitor Spark applications on the Data Mechanics platform.
Environment
- Python >= 3.5
- apache-airflow >= 1.10.x
Installation and usage
A tutorial to configure and use this plugin is available in the Data Mechanics docs.
Example DAGs
You can see example DAGs for the plugins in here.
Changelog
1.0.5 2020-09-11
Fixed
- Dependency management
1.0.0 2020-09-11
Changed
- Converted the existing plugin into a Python package
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file datamechanics_airflow_plugin-1.0.6.tar.gz.
File metadata
- Download URL: datamechanics_airflow_plugin-1.0.6.tar.gz
- Upload date:
- Size: 5.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fe35187d39aa5e5ca528cead8cb8289f1641ef1674e6b82c37a4cd02ff5a0248 |
|
| MD5 | 578b8f825e0f6135815faa21f0d85ed0 |
|
| BLAKE2b-256 | bebdde4429d2478f61b9098c9df4bb496f95bdaa7872b790d1c5a7f8381d8f2d |
File details
Details for the file datamechanics_airflow_plugin-1.0.6-py2.py3-none-any.whl.
File metadata
- Download URL: datamechanics_airflow_plugin-1.0.6-py2.py3-none-any.whl
- Upload date:
- Size: 7.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 91fd4a5dd3a032be569d536908c558fc68c38a3082a55d8c9403e1e3843fd4ba |
|
| MD5 | a6e96ace16811be9c17c6ffc4fa6e63c |
|
| BLAKE2b-256 | e2c2f8cc408f395825aa136b3e5168ab4b2956a4b81cf8be32fe7131f6cf0076 |
