Skip to main content

Provider for Apache Airflow. Implements apache-airflow-providers-apache-spark package

Project description

Package apache-airflow-providers-apache-spark

Release: 4.4.0

Apache Spark

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

The package supports the following python versions: 3.8,3.9,3.10,3.11

Requirements

PIP package

Version required

apache-airflow

>=2.5.0

pyspark

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-apache-spark[cncf.kubernetes]

Dependent package

Extra

apache-airflow-providers-cncf-kubernetes

cncf.kubernetes

The changelog for the provider package can be found in the changelog.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

apache-airflow-providers-apache-spark-4.4.0.tar.gz (29.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file apache-airflow-providers-apache-spark-4.4.0.tar.gz.

File metadata

File hashes

Hashes for apache-airflow-providers-apache-spark-4.4.0.tar.gz
Algorithm Hash digest
SHA256 6a02f3309582297f800897d3de7399dc00e8ffea50d89f5557d1938904453deb
MD5 148cc04dca00f5b460a12f1bbb9c17c3
BLAKE2b-256 e82394c7ba389a31f31380d925deac8f0c5fd48a839d7f48733c2adbd731b77f

See more details on using hashes here.

File details

Details for the file apache_airflow_providers_apache_spark-4.4.0-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-4.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d29135a293a49f28fa7f22a2e5a815da4a84ed9d479605c2209154bafdf18f20
MD5 c2d5197db6a4b5b5b4642b33615f7cc0
BLAKE2b-256 1bf7738e25d1f8539d7e5993626cfd7bf73918d257b26f9c023d92f15d4a5c71

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page