Skip to main content

Provider package apache-airflow-providers-apache-spark for Apache Airflow

Project description

Package apache-airflow-providers-apache-spark

Release: 5.3.1

Apache Spark

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

The package supports the following python versions: 3.10,3.11,3.12

Requirements

PIP package

Version required

apache-airflow

>=2.10.0

apache-airflow-providers-common-compat

>=1.5.0

pyspark

>=3.5.2

grpcio-status

>=1.59.0

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified providers in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-apache-spark[cncf.kubernetes]

Dependent package

Extra

apache-airflow-providers-cncf-kubernetes

cncf.kubernetes

apache-airflow-providers-common-compat

common.compat

The changelog for the provider package can be found in the changelog.

Project details


Release history Release notifications | RSS feed

This version

5.3.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

apache_airflow_providers_apache_spark-5.3.1.tar.gz (123.6 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file apache_airflow_providers_apache_spark-5.3.1.tar.gz.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-5.3.1.tar.gz
Algorithm Hash digest
SHA256 501c88b60ddc356b7c24302002cbd2f6fa86c5e43493d59e039b059bf0c61837
MD5 5d219bbe7f6b69104485ac32a6720d70
BLAKE2b-256 cdb651817e024e1eae6d59acc5f48f7055456f06734c1271f97af289a63ed4a1

See more details on using hashes here.

File details

Details for the file apache_airflow_providers_apache_spark-5.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-5.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f59a55c6ef0139f26f8ea21f235624342f5f982790c627ff19b3a630d024508d
MD5 eb823f54dcbcd6fc018eec73854f00b5
BLAKE2b-256 a88ae251285bb137a3cf57d45d5ef5b31ac931e9ea08a48d5dfb09c665ede86c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page