Flytekit Dask Plugin
Flyte can execute dask jobs natively on a Kubernetes Cluster, which manages the virtual dask cluster's lifecycle
(spin-up and tear down). It leverages the open-source Kubernetes Dask Operator and can be enabled without signing up
for any service. This is like running a transient (ephemeral) dask cluster - a type of cluster spun up for a specific
task and torn down after completion. This helps in making sure that the Python environment is the same on the job-runner
(driver), scheduler and the workers.
To install the plugin, run the following command:
pip install flytekitplugins-dask
To configure Dask in the Flyte deployment's backed, follow these directionsernetes/k8s_dask/index.html#step-2-environment-setup)
An usage example can be found in the documentation.
1 maintainer
Metadata
1 maintainer
Release files for flytekitplugins-dask 1.16.29
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| flytekitplugins_dask-1.16.29.tar.gz | 5.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| flytekitplugins_dask-1.16.29-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 10.8 kB
Release files / flytekitplugins_dask-1.16.29.tar.gz
| Download URL | flytekitplugins_dask-1.16.29.tar.gz |
|---|---|
| Size | 5.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e63e54c416e81cfce779a42e675673fb84d44aa36bc8349aef0062050cff14df
|
|
BLAKE2b-256 checksum How to use checksums |
ffb1e959f5aac68674a859d9af3b637d6081107f6eeb6180f41e15b380ae1d73
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.14
|
Release files / flytekitplugins_dask-1.16.29-py3-none-any.whl
| Download URL | flytekitplugins_dask-1.16.29-py3-none-any.whl |
|---|---|
| Size | 5.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
de3b864df6796b9034942b8fc105b7f2aacff04546ad307cbeead40af19334e5
|
|
BLAKE2b-256 checksum How to use checksums |
afeaddcd2455e15c2a36963fa6aa468682320bb25b38bb15804a8e3af12ef9c5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.14
|
