Flytekit Dask Plugin

Flyte can execute dask jobs natively on a Kubernetes Cluster, which manages the virtual dask cluster's lifecycle (spin-up and tear down). It leverages the open-source Kubernetes Dask Operator and can be enabled without signing up for any service. This is like running a transient (ephemeral) dask cluster - a type of cluster spun up for a specific task and torn down after completion. This helps in making sure that the Python environment is the same on the job-runner (driver), scheduler and the workers.

To install the plugin, run the following command:

pip install flytekitplugins-dask

To configure Dask in the Flyte deployment's backed, follow these directionsernetes/k8s_dask/index.html#step-2-environment-setup)

An usage example can be found in the documentation.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for flyte-bot from gravatar.com flyte-bot

Credits

Author: flyteorg

License

Apache Software License (apache2)

Requires

Python >=3.9

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flytekitplugins_dask-1.16.28.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flytekitplugins_dask-1.16.28-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file flytekitplugins_dask-1.16.28.tar.gz.

File metadata

  • Download URL: flytekitplugins_dask-1.16.28.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.13

File hashes

Hashes for flytekitplugins_dask-1.16.28.tar.gz
Algorithm Hash digest
SHA256 7e665ccb180db187076a66a484c08d87b24f8cbdd43575ffc475510cddadc759
MD5 1b1b8815c9ae8603de53ea1cd6bf95aa
BLAKE2b-256 53e59821d4d5c601cb2192b0892be27843d7e3bfe7d6e6b4b5228af626801028

See more details on using hashes here.

File details

Details for the file flytekitplugins_dask-1.16.28-py3-none-any.whl.

File metadata

File hashes

Hashes for flytekitplugins_dask-1.16.28-py3-none-any.whl
Algorithm Hash digest
SHA256 6db32da08a38ed8db042780362dbdb34fbbf69041cccf62e179b593b9e3b2fda
MD5 afda55d5d09d6cb7cf29ea4216611776
BLAKE2b-256 49b1267595ede24c63a9c2a9e378d25f9b8696e9f0e0f29df49d1250042dcce5

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

1.16.28 This release

2 files

1.16.27

2 files

1.16.26

2 files

1.16.25

2 files

1.16.24

2 files

1.16.23

2 files

1.16.22

2 files

1.16.21

2 files

Pre-release

1.16.21b0

2 files

1.16.20

2 files

1.16.19

2 files

1.16.16

2 files

1.16.15

2 files

1.16.14

2 files

1.16.13

2 files

1.16.12

2 files

Pre-release

1.16.12a0

2 files

1.16.11

2 files

1.16.10

2 files

1.16.9

2 files

1.16.8

2 files

1.16.7

2 files

1.16.6

2 files

1.16.5

2 files

1.16.4

2 files

1.16.3

2 files

1.16.2

2 files

Pre-release

1.16.2b1

2 files

Pre-release

1.16.2b0

2 files

1.16.1

2 files

Pre-release

1.16.1b0

2 files

1.16.0

2 files

Pre-release

1.16.0b7

2 files

Pre-release

1.16.0b6

2 files

Pre-release

1.16.0b5

2 files

Pre-release

1.16.0b3

2 files

1.15.4

2 files

1.15.3

2 files

1.15.2

2 files

1.15.1

2 files

Pre-release

1.15.1b0

2 files

1.15.0

2 files

Pre-release

1.15.0b5

2 files

Pre-release

1.15.0b4

2 files

Pre-release

1.15.0b3

2 files

Pre-release

1.15.0b2

2 files

Pre-release

1.15.0b1

2 files

Pre-release

1.15.0b0

2 files

Pre-release

1.15.0a1

2 files

Pre-release

1.15.0a0

2 files

1.14.9

2 files

1.14.8

2 files

1.14.7

2 files

1.14.6

2 files

1.14.5

2 files

1.14.4

2 files

1.14.3

2 files

1.14.2

2 files

1.14.1

2 files

1.14.0

2 files

Pre-release

1.14.0b6

2 files

Pre-release

1.14.0b5

2 files

Pre-release

1.14.0b4

2 files

Pre-release

1.14.0b3

2 files

Pre-release

1.14.0b2

2 files

Pre-release

1.14.0b1

2 files

Pre-release

1.14.0b0

2 files

1.13.15

2 files

1.13.14

2 files

1.13.13

2 files

1.13.12

2 files

1.13.11

2 files

1.13.10

1 file

1.13.9

2 files

1.13.8

2 files

1.13.7

2 files

1.13.6

2 files

Pre-release

1.13.6b2

2 files

Pre-release

1.13.6b1

2 files

Pre-release

1.13.6b0

2 files

1.13.5

2 files

1.13.4

2 files

1.13.3

2 files

1.13.2

2 files

Pre-release

1.13.2b1

2 files

Pre-release

1.13.2b0

2 files

1.13.1

2 files

Pre-release

1.13.1a5

2 files

Pre-release

1.13.1a4

2 files

Pre-release

1.13.1a3

2 files

Pre-release

1.13.1a2

2 files

Pre-release

1.13.1a1

2 files

Pre-release

1.13.1a0

2 files

1.13.0

2 files

1.12.3

2 files

Pre-release

1.12.3b0

2 files

1.12.2

2 files

Pre-release

1.12.1rc1

2 files

Pre-release

1.12.1rc0

2 files

Pre-release

1.12.1b4

2 files

Pre-release

1.12.1b3

2 files

Pre-release

1.12.1b2

2 files

Pre-release

1.12.1b1

2 files

Pre-release

1.12.1b0

2 files

1.12.0

2 files

Pre-release

1.12.0b7

2 files

Pre-release

1.12.0b6

2 files

Pre-release

1.12.0b5

2 files

Pre-release

1.12.0b4

2 files

Pre-release

1.12.0b3

2 files

Pre-release

1.12.0b2

2 files

Pre-release

1.12.0b1

2 files

Pre-release

1.12.0b0

2 files

1.11.0

2 files

Pre-release

1.10.8b4

2 files

Pre-release

1.10.8b3

2 files

Pre-release

1.10.8b2

2 files

Pre-release

1.10.8b1

2 files

Pre-release

1.10.8b0

2 files

1.10.7

2 files

Pre-release

1.10.7b0

2 files

1.10.3

2 files

Pre-release

1.10.3b7

2 files

Pre-release

1.10.3b6

2 files

Pre-release

1.10.3b5

2 files

Pre-release

1.10.3b4

2 files

Pre-release

1.10.3b3

2 files

Pre-release

1.10.3b2

2 files

1.10.2

2 files

1.10.1

2 files

Pre-release

1.10.1b0

2 files

1.10.0

2 files

Pre-release

1.10.0b0

2 files

1.9.1

2 files

1.9.0

2 files

Pre-release

1.9.0a0

2 files

1.8.3

2 files

1.8.2

2 files

1.8.1

2 files

1.8.0

2 files

1.7.1

2 files

Pre-release

1.7.1b1

2 files

Pre-release

1.7.1b0

2 files

1.7.0

2 files

1.6.3

2 files

1.6.2

2 files

Pre-release

1.6.2b1

2 files

Pre-release

1.6.2b0

2 files

1.6.1

2 files

Pre-release

1.6.1b0

2 files

1.6.0

2 files

Pre-release

1.6.0b4

2 files

Pre-release

1.6.0b3

2 files

Pre-release

1.6.0b2

2 files

Pre-release

1.6.0b1

2 files

Pre-release

1.6.0b0

2 files

Pre-release

1.6.0a1

2 files

1.5.0

2 files

Pre-release

1.5.0b1

2 files

Pre-release

1.5.0b0

2 files

1.4.2

2 files

Pre-release

1.4.2b0

2 files

1.4.1

2 files

1.4.0

2 files

Pre-release

1.4.0b1

2 files

Pre-release

1.4.0b0

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page