Union Spark Plugin
Union can execute Spark jobs natively on a Kubernetes Cluster, which manages a virtual cluster’s lifecycle, spin-up, and tear down. It leverages the open-sourced Spark On K8s Operator and can be enabled without signing up for any service. This is like running a transient spark cluster — a type of cluster spun up for a specific Spark job and torn down after completion.
To install the plugin, run the following command:
pip install --pre flyteplugins-spark
1 maintainer
Metadata
1 maintainer
Release files for flyteplugins-spark 2.11.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| flyteplugins_spark-2.11.4-py3-none-any.whl | Python 3 | none | any | Details |
Release files / flyteplugins_spark-2.11.4-py3-none-any.whl
| Download URL | flyteplugins_spark-2.11.4-py3-none-any.whl |
|---|---|
| Size | 4.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9883aefb2a34ef2f5db3bf032e1a2296c9e41f5c39f5c7b0cb4ac16a93b63cdb
|
|
BLAKE2b-256 checksum How to use checksums |
025eed52eed0058cda6d96f2bb8504d68b99af1ca26012adcba90b1c3f9ddf98
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
