Skip to main content

Provider for Apache Airflow. Implements apache-airflow-providers-apache-spark package

Project description

Package apache-airflow-providers-apache-spark

Release: 4.4.0rc1

Apache Spark

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

The package supports the following python versions: 3.8,3.9,3.10,3.11

Requirements

PIP package

Version required

apache-airflow

>=2.5.0

pyspark

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-apache-spark[cncf.kubernetes]

Dependent package

Extra

apache-airflow-providers-cncf-kubernetes

cncf.kubernetes

The changelog for the provider package can be found in the changelog.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file apache-airflow-providers-apache-spark-4.4.0rc1.tar.gz.

File metadata

File hashes

Hashes for apache-airflow-providers-apache-spark-4.4.0rc1.tar.gz
Algorithm Hash digest
SHA256 15d9132183e1278aa4a997818a30ec9137c7f0f5088bf837405d20c5b723f017
MD5 9a1d9c4f82f4406df826b38a372dabd5
BLAKE2b-256 7cf9f3b87fdb6f81764a44f31a59f4b85d50547d89bf19c7a1cd27d0eb7fce0e

See more details on using hashes here.

File details

Details for the file apache_airflow_providers_apache_spark-4.4.0rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-4.4.0rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 879e1ffa5a16cd9fd86a29b5734a89041fbb048c006d79d7a043d68a4aeaad46
MD5 b91011bbc6d5711e3528f31eab5f29c7
BLAKE2b-256 1fd75c975da9f23baf1382d86fda1f7f4dfa77a6f8c8b7cdb3d6a6e450caf7a0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page