Skip to main content

Package apache-airflow-providers-apache-spark

Release: 6.3.2

Apache Spark

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

The package supports the following python versions: 3.10,3.11,3.12,3.13,3.14

Requirements

PIP package

Version required

apache-airflow

>=2.11.0

apache-airflow-providers-common-compat

>=1.12.0

pyspark-client

>=4.0.0

grpcio-status

>=1.67.0

requests

>=2.32.0

tenacity

>=8.3.0

Optional cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified providers in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-apache-spark[cncf.kubernetes]

Dependent package

Extra

apache-airflow-providers-cncf-kubernetes

cncf.kubernetes

Optional dependencies

Extra

Dependencies

cncf.kubernetes

apache-airflow-providers-cncf-kubernetes>=7.4.0

openlineage

apache-airflow-providers-openlineage

pyspark

pyspark>=4.0.0

The changelog for the provider package can be found in the changelog.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

apache_airflow_providers_apache_spark-6.3.2.tar.gz (163.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file apache_airflow_providers_apache_spark-6.3.2.tar.gz.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-6.3.2.tar.gz
Algorithm Hash digest
SHA256 0eb2207c0960c5701e1b61632060c0c4633c72c04b9a2fcae880567ba6fbbbf8
MD5 85c42c3772ff823d777f49c7374c0e1b
BLAKE2b-256 1d59886f76a57d8fbf56a3770e23978a47dc4406aa479f12f2edbe8a82140242

See more details on using hashes here.

File details

Details for the file apache_airflow_providers_apache_spark-6.3.2-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-6.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 0e40344000fa4bdd982b6af7f816fc278b1573a94e7dfaf2241bcdfb52d5bc0d
MD5 bb966ced73316ad24fd2cf6748656733
BLAKE2b-256 5c9dff449a26fdca21204ddda3eab90a4b52ac2ab917646297fb629c75948cb9

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

6.3.2 This release

2 files

6.3.1

2 files

6.3.0

2 files

6.2.0

2 files

6.1.0

2 files

6.0.2

2 files

6.0.1

2 files

6.0.0

2 files

5.6.0

2 files

5.5.1

2 files

5.5.0

2 files

5.4.2

2 files

5.4.1

2 files

5.4.0

2 files

5.3.4

2 files

5.3.3

2 files

5.3.2

2 files

5.3.1

2 files

5.3.0

2 files

5.2.1

2 files

5.2.0

2 files

5.1.1

2 files

5.0.1

2 files

5.0.0

2 files

4.11.3

2 files

4.11.2

2 files

4.11.1

2 files

4.11.0

2 files

4.10.0

2 files

4.9.0

2 files

4.8.2

2 files

4.8.1

2 files

4.8.0

2 files

4.7.2

2 files

4.7.1

2 files

4.7.0

2 files

4.6.0

2 files

4.5.0

2 files

4.4.0

2 files

4.3.0

2 files

4.2.0

2 files

4.1.5

2 files

4.1.4

2 files

4.1.3

2 files

4.1.2

2 files

4.1.1

2 files

4.1.0

2 files

4.0.1

2 files

4.0.0

2 files

3.0.0

2 files

2.1.3

2 files

2.1.2

2 files

2.1.1

2 files

2.1.0

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.0.3

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page