This release is a pre-release and may not be stable for production use.
Package apache-airflow-providers-apache-spark
Release: 6.3.3
Provider package
This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing Airflow installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark
The package supports the following python versions: 3.11,3.12,3.13,3.14
Requirements
PIP package |
Version required |
|---|---|
apache-airflow |
>=2.11.0 |
apache-airflow-providers-common-compat |
>=1.12.0 |
pyspark-client |
>=4.0.0 |
grpcio-status |
>=1.67.0 |
requests |
>=2.32.0 |
tenacity |
>=8.3.0 |
Optional cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified providers in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-apache-spark[cncf.kubernetes]Dependent package |
Extra |
|---|---|
cncf.kubernetes |
Optional dependencies
Extra |
Dependencies |
|---|---|
cncf.kubernetes |
apache-airflow-providers-cncf-kubernetes>=7.4.0 |
openlineage |
apache-airflow-providers-openlineage |
pyspark |
pyspark>=4.0.0 |
The changelog for the provider package can be found in the changelog.
Release files for apache-airflow-providers-apache-spark 6.3.3rc1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| apache_airflow_providers_apache_spark-6.3.3rc1.tar.gz | 166.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| apache_airflow_providers_apache_spark-6.3.3rc1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 229.7 kB
Release files / apache_airflow_providers_apache_spark-6.3.3rc1.tar.gz
| Download URL | apache_airflow_providers_apache_spark-6.3.3rc1.tar.gz |
|---|---|
| Size | 166.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
47bf520254980b77b63de4806be6db044d9267d5a4a02b5624cc9c4ec28ab5fa
|
|
BLAKE2b-256 checksum How to use checksums |
fa1e58f891fe7fead0093f2403770644a8647417b340143a67615a0251d6deea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.11
|
Release files / apache_airflow_providers_apache_spark-6.3.3rc1-py3-none-any.whl
| Download URL | apache_airflow_providers_apache_spark-6.3.3rc1-py3-none-any.whl |
|---|---|
| Size | 63.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ff432c580f93395539d4d99b03dd40de2a033d1bc9d08d5812be140fde34549e
|
|
BLAKE2b-256 checksum How to use checksums |
72c72d1a3e54346a463b0f9b5b924417db7968ea9a2886ec917b0f8acf93db32
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.11
|
