Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Package apache-airflow-providers-apache-spark

Release: 6.3.4

Apache Spark

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

The package supports the following python versions: 3.11,3.12,3.13,3.14

Requirements

PIP package

Version required

apache-airflow

>=2.11.0

apache-airflow-providers-common-compat

>=1.23.0

pyspark-client

>=4.0.0

grpcio-status

>=1.67.0

requests

>=2.32.0

tenacity

>=8.3.0

Optional cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified providers in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-apache-spark[cncf.kubernetes]

Dependent package

Extra

apache-airflow-providers-cncf-kubernetes

cncf.kubernetes

Optional dependencies

Extra

Dependencies

cncf.kubernetes

apache-airflow-providers-cncf-kubernetes>=7.4.0

openlineage

apache-airflow-providers-openlineage

pyspark

pyspark>=4.0.0

The changelog for the provider package can be found in the changelog.

Metadata

Release files for apache-airflow-providers-apache-spark 6.3.4rc1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for apache-airflow-providers-apache-spark 6.3.4rc1
File Size Uploaded Provenance
apache_airflow_providers_apache_spark-6.3.4rc1.tar.gz 166.4 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for apache-airflow-providers-apache-spark 6.3.4rc1
File Interpreter ABI Platform
apache_airflow_providers_apache_spark-6.3.4rc1-py3-none-any.whl Python 3 none any Details

Total release size: 229.7 kB

Release files / apache_airflow_providers_apache_spark-6.3.4rc1.tar.gz

Download URL apache_airflow_providers_apache_spark-6.3.4rc1.tar.gz
Size 166.4 kB
Tags Source
SHA-256 checksum
How to use checksums
9407740c2667cd35c534b3f6edd5f175eb929b7ab46d945e5a28791c43132862
BLAKE2b-256 checksum
How to use checksums
20bdc1e12e8ee66d3adeec98937bcd4a195195359be5637fa7391886de1e2091
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.5

Release files / apache_airflow_providers_apache_spark-6.3.4rc1-py3-none-any.whl

Download URL apache_airflow_providers_apache_spark-6.3.4rc1-py3-none-any.whl
Size 63.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b356932d4c98afa17c660e938e9119109233ebb20fa2ffe87c645d11590ecc2c
BLAKE2b-256 checksum
How to use checksums
779a6adbc6af9413164b2a9ca622fcdfa24d7a6b5e7ce871065aeb0f32d13af4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.5

Security for apache-airflow-providers-apache-spark 6.3.4rc1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Release history Release notifications | RSS feed

This release
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page