Provider package apache-airflow-providers-apache-spark for Apache Airflow
Project description
Package apache-airflow-providers-apache-spark
Release: 6.1.0
Provider package
This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing Airflow installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark
The package supports the following python versions: 3.10,3.11,3.12,3.13,3.14
Requirements
PIP package |
Version required |
|---|---|
apache-airflow |
>=2.11.0 |
apache-airflow-providers-common-compat |
>=1.12.0 |
pyspark-client |
>=4.0.0 |
grpcio-status |
>=1.67.0 |
requests |
>=2.32.0 |
tenacity |
>=8.3.0 |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified providers in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-apache-spark[cncf.kubernetes]Dependent package |
Extra |
|---|---|
cncf.kubernetes |
|
common.compat |
Optional dependencies
Extra |
Dependencies |
|---|---|
cncf.kubernetes |
apache-airflow-providers-cncf-kubernetes>=7.4.0 |
openlineage |
apache-airflow-providers-openlineage |
pyspark |
pyspark>=4.0.0 |
The changelog for the provider package can be found in the changelog.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file apache_airflow_providers_apache_spark-6.1.0.tar.gz.
File metadata
- Download URL: apache_airflow_providers_apache_spark-6.1.0.tar.gz
- Upload date:
- Size: 154.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8839b426183455ec74e9a4a65685cf4fb53740b2fa0cd9389968c1762c9ac303
|
|
| MD5 |
d4d372b8714d0f43ce702952974467d9
|
|
| BLAKE2b-256 |
a048fb5987e32bca0ac27bea4fb0035508df8dc7521a5954fb3b42128bcb5a71
|
File details
Details for the file apache_airflow_providers_apache_spark-6.1.0-py3-none-any.whl.
File metadata
- Download URL: apache_airflow_providers_apache_spark-6.1.0-py3-none-any.whl
- Upload date:
- Size: 59.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
97fd5597295f8f33bfedc5025aa776e4272ca5247f35221003f2cae7e1589972
|
|
| MD5 |
8053faf5c2a508768ea1967ea72e2c8a
|
|
| BLAKE2b-256 |
4555c2db600ed51b4cf35950eea2acc5d499949790eb234dbe7d16216fcfd3d7
|
