Airflow Ray Executor
Airflow executor implemented using ray
Usage
$ pip install airflow-ray-executor
Edit your airflow.cfg to set your executor to class: airflow_ray_executor.RayExecutor and add ray client address to this file, example:
executor = airflow_ray_executor.RayExecutor
[ray]
# ray client address to connect to ray cluster
# Ray Executor will start Ray on a single machine if not provided
client = ray://127.0.0.1:10001
Please note: Airflow not support sqlite database when executor neither DebugExecutor nor SequentialExecutor
1 maintainer
Metadata
1 maintainer
Release files for airflow-ray-executor 0.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| airflow-ray-executor-0.0.1.tar.gz | 12.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| airflow_ray_executor-0.0.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 26.1 kB
Release files / airflow-ray-executor-0.0.1.tar.gz
| Download URL | airflow-ray-executor-0.0.1.tar.gz |
|---|---|
| Size | 12.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
60f2a56cd0e9ebd70368fc3274d5f22fb54fb5982ae345e071467ed68df52d79
|
|
BLAKE2b-256 checksum How to use checksums |
554a4ef1462c9d88bde1979a47fd4eaddb4cd1754da54c4297f410ab98d8a16c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12
|
Release files / airflow_ray_executor-0.0.1-py3-none-any.whl
| Download URL | airflow_ray_executor-0.0.1-py3-none-any.whl |
|---|---|
| Size | 13.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
470a8aa53cf2704aa479f235b0b56562792768064eda64e7d4492ff3e5b67d29
|
|
BLAKE2b-256 checksum How to use checksums |
a593a59f049e40ab686d53160583f8bb50667746e2d87f76df493f6817d91b3a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12
|
