An Airflow plugin to launch and monitor Spark applications on the Data Mechanics platform
Project description
Data Mechanics Airflow Plugin
An Airflow plugin to launch and monitor Spark applications on the Data Mechanics platform.
Environment
- Python >= 3.5
- apache-airflow >= 1.10.x
Installation and usage
A tutorial to configure and use this plugin is available in the Data Mechanics docs.
Example DAGs
You can see example DAGs for the plugins in here.
Changelog
1.0.5 2020-09-11
Fixed
- Dependency management
1.0.0 2020-09-11
Changed
- Converted the existing plugin into a Python package
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for datamechanics_airflow_plugin-1.0.6.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fe35187d39aa5e5ca528cead8cb8289f1641ef1674e6b82c37a4cd02ff5a0248 |
|
| MD5 | 578b8f825e0f6135815faa21f0d85ed0 |
|
| BLAKE2b-256 | bebdde4429d2478f61b9098c9df4bb496f95bdaa7872b790d1c5a7f8381d8f2d |
Close
Hashes for datamechanics_airflow_plugin-1.0.6-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 91fd4a5dd3a032be569d536908c558fc68c38a3082a55d8c9403e1e3843fd4ba |
|
| MD5 | a6e96ace16811be9c17c6ffc4fa6e63c |
|
| BLAKE2b-256 | e2c2f8cc408f395825aa136b3e5168ab4b2956a4b81cf8be32fe7131f6cf0076 |
