apache-airflow-backport-providers-apache-beam 2021.3.13rc1

Backport provider package apache-airflow-backport-providers-apache-beam for Apache Airflow

Package apache-airflow-backport-providers-apache-beam

Release: 2021.3.13

Table of contents

• Backport package
• Installation
• PIP requirements
• Cross provider package dependencies
• Provider class summary
  • Operators
    • New operators
  • Hooks
    • New hooks
• Releases
  • Release 2021.3.13
  • Release 2021.2.5

Backport package

This is a backport providers package for apache.beam provider. All classes for this provider package are in airflow.providers.apache.beam python package.

Only Python 3.6+ is supported for this backport package.

While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you want to use this backport package.

Release 2021.3.13

Bug fixes

• Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)
• Corrections in docs and tools after releasing provider RCs (#14082)
• Remove WARNINGs from BeamHook (#14554)

Installation

You can install this package on top of an existing airflow 1.10.* installation via pip install apache-airflow-backport-providers-apache-beam

PIP requirements

PIP package	Version required
apache-beam[gcp]

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-backport-providers-apache-beam[google]

Dependent package	Extra
apache-airflow-backport-providers-google	google

Provider classes summary

In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the apache.beam provider are in the airflow.providers.apache.beam package. You can read more about the naming conventions used in Naming conventions for provider packages

Operators

New operators

New Airflow 2.0 operators: airflow.providers.apache.beam package
operators.beam.BeamRunJavaPipelineOperator
operators.beam.BeamRunPythonPipelineOperator

Hooks

New hooks

New Airflow 2.0 hooks: airflow.providers.apache.beam package
hooks.beam.BeamHook

Releases

Release 2021.3.13

Commit	Committed	Subject
4e5763060	2021-03-03	Remove WARNINGs from BeamHook (#14554)
589d6dec9	2021-02-27	Prepare to release the next wave of providers: (#14487)
8a731f536	2021-02-05	Improve Apache Beam operators - refactor operator - common Dataflow logic (#14094)
10343ec29	2021-02-05	Corrections in docs and tools after releasing provider RCs (#14082)

Release 2021.2.5

Commit	Committed	Subject
d45739f7c	2021-02-04	Fixes to release process after releasing 2nd wave of providers (#14059)
1872d8719	2021-02-03	Add Apache Beam operators (#12814)