Skip to main content

Backport provider package apache-airflow-backport-providers-apache-beam for Apache Airflow

Project description

Package apache-airflow-backport-providers-apache-beam

Release: 2021.3.13

Table of contents

Backport package

This is a backport providers package for apache.beam provider. All classes for this provider package are in airflow.providers.apache.beam python package.

Only Python 3.6+ is supported for this backport package.

While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you want to use this backport package.

Release 2021.3.13

Bug fixes

  • Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)
  • Corrections in docs and tools after releasing provider RCs (#14082)
  • Remove WARNINGs from BeamHook (#14554)

Installation

You can install this package on top of an existing airflow 1.10.* installation via pip install apache-airflow-backport-providers-apache-beam

PIP requirements

PIP package Version required
apache-beam[gcp]

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-backport-providers-apache-beam[google]
Dependent package Extra
apache-airflow-backport-providers-google google

Provider classes summary

In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the apache.beam provider are in the airflow.providers.apache.beam package. You can read more about the naming conventions used in Naming conventions for provider packages

Operators

New operators

New Airflow 2.0 operators: airflow.providers.apache.beam package
operators.beam.BeamRunJavaPipelineOperator
operators.beam.BeamRunPythonPipelineOperator

Hooks

New hooks

New Airflow 2.0 hooks: airflow.providers.apache.beam package
hooks.beam.BeamHook

Releases

Release 2021.3.13

Commit Committed Subject
4e5763060 2021-03-03 Remove WARNINGs from BeamHook (#14554)
589d6dec9 2021-02-27 Prepare to release the next wave of providers: (#14487)
8a731f536 2021-02-05 Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)
10343ec29 2021-02-05 Corrections in docs and tools after releasing provider RCs (#14082)

Release 2021.2.5

Commit Committed Subject
d45739f7c 2021-02-04 Fixes to release process after releasing 2nd wave of providers (#14059)
1872d8719 2021-02-03 Add Apache Beam operators (#12814)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page