Machine Learning Orchestration
Project description
Dbnd Airflow Operator
This plugin was written to provide an explicit way of declaratively passing messages between two airflow operators.
This plugin was inspired by AIP-31. Essentially, this plugin connects between dbnd's implementation of tasks and pipelines to airflow operators.
This implementation uses XCom communication and XCom templates to transfer said messages. This plugin is fully functional, however as soon as AIP-31 is implemented it will support all edge-cases.
Fully tested on airflow 1.10.X.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file dbnd-airflow-operator-0.25.4.tar.gz
.
File metadata
- Download URL: dbnd-airflow-operator-0.25.4.tar.gz
- Upload date:
- Size: 12.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.6.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f979992ff66c26dc4b874599aa55ca0142105de833f488a8cbca3d97a3d0286 |
|
MD5 | c571d9af88263544c3c5c0836e08a3fe |
|
BLAKE2b-256 | bdcd2ef80f75824b28982e4b2ca361e2179935f9381494690b50ec2ba5d5e56f |
File details
Details for the file dbnd_airflow_operator-0.25.4-py2.py3-none-any.whl
.
File metadata
- Download URL: dbnd_airflow_operator-0.25.4-py2.py3-none-any.whl
- Upload date:
- Size: 13.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.6.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | af91e1f9374c9326a355a045c665da6362e61a8d7aa0d391d052cb27119d2ef8 |
|
MD5 | 8e0aea0bc40179d19121faff01f42ae3 |
|
BLAKE2b-256 | cd0590efa652c8b4bf0722259d21709d82b2575d8efbe7942ffbec368a5ac714 |