Flytekit Dask Plugin

Flyte can execute dask jobs natively on a Kubernetes Cluster, which manages the virtual dask cluster's lifecycle (spin-up and tear down). It leverages the open-source Kubernetes Dask Operator and can be enabled without signing up for any service. This is like running a transient (ephemeral) dask cluster - a type of cluster spun up for a specific task and torn down after completion. This helps in making sure that the Python environment is the same on the job-runner (driver), scheduler and the workers.

To install the plugin, run the following command:

pip install flytekitplugins-dask

To configure Dask in the Flyte deployment's backed, follow these directionsernetes/k8s_dask/index.html#step-2-environment-setup)

An usage example can be found in the documentation.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (1.16.28)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for flyte-bot from gravatar.com flyte-bot

Credits

Author: flyteorg

License

Apache Software License (apache2)

Requires

Python >=3.9

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flytekitplugins_dask-1.16.26.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flytekitplugins_dask-1.16.26-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file flytekitplugins_dask-1.16.26.tar.gz.

File metadata

  • Download URL: flytekitplugins_dask-1.16.26.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for flytekitplugins_dask-1.16.26.tar.gz
Algorithm Hash digest
SHA256 6670fe36d06222effba44ea0fdb30c74d27d46deb19b67a8b092f4e7624e0aa6
MD5 4421be01ffdf42b5edce8c77dbce55c4
BLAKE2b-256 fe1c35e30a663a1a61064c3526bf6af36f0d77db4f5f8daea52c5b7e21e3cf67

See more details on using hashes here.

File details

Details for the file flytekitplugins_dask-1.16.26-py3-none-any.whl.

File metadata

File hashes

Hashes for flytekitplugins_dask-1.16.26-py3-none-any.whl
Algorithm Hash digest
SHA256 58398665632ddb4a9fa3fc8065e9ec2f231f99d987916373e07f23e7d3b18a97
MD5 c45ec78059d009cff682e662463319d3
BLAKE2b-256 b18256f214d2ade9d81936bb0a1e66a2bb1381556c8a11e95a7d1394da4a705a

See more details on using hashes here.

Release history Release notifications | RSS feed

1.16.28

2 files

1.16.27

2 files

This release

1.16.26 This release

2 files

1.16.25

2 files

1.16.24

2 files

1.16.23

2 files

1.16.22

2 files

1.16.21

2 files

Pre-release

1.16.21b0

2 files

1.16.20

2 files

1.16.19

2 files

1.16.16

2 files

1.16.15

2 files

1.16.14

2 files

1.16.13

2 files

1.16.12

2 files

Pre-release

1.16.12a0

2 files

1.16.11

2 files

1.16.10

2 files

1.16.9

2 files

1.16.8

2 files

1.16.7

2 files

1.16.6

2 files

1.16.5

2 files

1.16.4

2 files

1.16.3

2 files

1.16.2

2 files

Pre-release

1.16.2b1

2 files

Pre-release

1.16.2b0

2 files

1.16.1

2 files

Pre-release

1.16.1b0

2 files

1.16.0

2 files

Pre-release

1.16.0b7

2 files

Pre-release

1.16.0b6

2 files

Pre-release

1.16.0b5

2 files

Pre-release

1.16.0b3

2 files

1.15.4

2 files

1.15.3

2 files

1.15.2

2 files

1.15.1

2 files

Pre-release

1.15.1b0

2 files

1.15.0

2 files

Pre-release

1.15.0b5

2 files

Pre-release

1.15.0b4

2 files

Pre-release

1.15.0b3

2 files

Pre-release

1.15.0b2

2 files

Pre-release

1.15.0b1

2 files

Pre-release

1.15.0b0

2 files

Pre-release

1.15.0a1

2 files

Pre-release

1.15.0a0

2 files

1.14.9

2 files

1.14.8

2 files

1.14.7

2 files

1.14.6

2 files

1.14.5

2 files

1.14.4

2 files

1.14.3

2 files

1.14.2

2 files

1.14.1

2 files

1.14.0

2 files

Pre-release

1.14.0b6

2 files

Pre-release

1.14.0b5

2 files

Pre-release

1.14.0b4

2 files

Pre-release

1.14.0b3

2 files

Pre-release

1.14.0b2

2 files

Pre-release

1.14.0b1

2 files

Pre-release

1.14.0b0

2 files

1.13.15

2 files

1.13.14

2 files

1.13.13

2 files

1.13.12

2 files

1.13.11

2 files

1.13.10

1 file

1.13.9

2 files

1.13.8

2 files

1.13.7

2 files

1.13.6

2 files

Pre-release

1.13.6b2

2 files

Pre-release

1.13.6b1

2 files

Pre-release

1.13.6b0

2 files

1.13.5

2 files

1.13.4

2 files

1.13.3

2 files

1.13.2

2 files

Pre-release

1.13.2b1

2 files

Pre-release

1.13.2b0

2 files

1.13.1

2 files

Pre-release

1.13.1a5

2 files

Pre-release

1.13.1a4

2 files

Pre-release

1.13.1a3

2 files

Pre-release

1.13.1a2

2 files

Pre-release

1.13.1a1

2 files

Pre-release

1.13.1a0

2 files

1.13.0

2 files

1.12.3

2 files

Pre-release

1.12.3b0

2 files

1.12.2

2 files

Pre-release

1.12.1rc1

2 files

Pre-release

1.12.1rc0

2 files

Pre-release

1.12.1b4

2 files

Pre-release

1.12.1b3

2 files

Pre-release

1.12.1b2

2 files

Pre-release

1.12.1b1

2 files

Pre-release

1.12.1b0

2 files

1.12.0

2 files

Pre-release

1.12.0b7

2 files

Pre-release

1.12.0b6

2 files

Pre-release

1.12.0b5

2 files

Pre-release

1.12.0b4

2 files

Pre-release

1.12.0b3

2 files

Pre-release

1.12.0b2

2 files

Pre-release

1.12.0b1

2 files

Pre-release

1.12.0b0

2 files

1.11.0

2 files

Pre-release

1.10.8b4

2 files

Pre-release

1.10.8b3

2 files

Pre-release

1.10.8b2

2 files

Pre-release

1.10.8b1

2 files

Pre-release

1.10.8b0

2 files

1.10.7

2 files

Pre-release

1.10.7b0

2 files

1.10.3

2 files

Pre-release

1.10.3b7

2 files

Pre-release

1.10.3b6

2 files

Pre-release

1.10.3b5

2 files

Pre-release

1.10.3b4

2 files

Pre-release

1.10.3b3

2 files

Pre-release

1.10.3b2

2 files

1.10.2

2 files

1.10.1

2 files

Pre-release

1.10.1b0

2 files

1.10.0

2 files

Pre-release

1.10.0b0

2 files

1.9.1

2 files

1.9.0

2 files

Pre-release

1.9.0a0

2 files

1.8.3

2 files

1.8.2

2 files

1.8.1

2 files

1.8.0

2 files

1.7.1

2 files

Pre-release

1.7.1b1

2 files

Pre-release

1.7.1b0

2 files

1.7.0

2 files

1.6.3

2 files

1.6.2

2 files

Pre-release

1.6.2b1

2 files

Pre-release

1.6.2b0

2 files

1.6.1

2 files

Pre-release

1.6.1b0

2 files

1.6.0

2 files

Pre-release

1.6.0b4

2 files

Pre-release

1.6.0b3

2 files

Pre-release

1.6.0b2

2 files

Pre-release

1.6.0b1

2 files

Pre-release

1.6.0b0

2 files

Pre-release

1.6.0a1

2 files

1.5.0

2 files

Pre-release

1.5.0b1

2 files

Pre-release

1.5.0b0

2 files

1.4.2

2 files

Pre-release

1.4.2b0

2 files

1.4.1

2 files

1.4.0

2 files

Pre-release

1.4.0b1

2 files

Pre-release

1.4.0b0

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page