Backport provider package apache-airflow-backport-providers-google for Apache Airflow
Project description
Package apache-airflow-backport-providers-google
Release: 2021.3.3
Table of contents
- Backport package
- Installation
- PIP requirements
- Cross provider package dependencies
- Provider class summary
- Releases
Backport package
This is a backport providers package for google provider. All classes for this provider package
are in airflow.providers.google python package.
Only Python 3.6+ is supported for this backport package.
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you want to use this backport package.
Changelog
Release 2021.3.3
Features
Corrects order of argument in docstring in GCSHook.download method (#14497)Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)Add GoogleDriveToLocalOperator (#14191)Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)Add materialized view support for BigQuery (#14201)Add BigQueryUpdateTableOperator (#14149)Add param to CloudDataTransferServiceOperator (#14118)Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook (#13982)Improve GCSToSFTPOperator paths handling (#11284)
Bug fixes
Fixes to dataproc operators and hook (#14086)#9803 fix bug in copy operation without wildcard (#13919)
Release 2021.2.5
Breaking changes
Updated google-cloud-* libraries
This release of the provider package contains third-party library updates, which may require updating your DAG files or custom hooks and operators, if you were using objects from those libraries. Updating of these libraries is necessary to be able to use new features made available by new versions of the libraries and to obtain bug fixes that are only available for new versions of the library.
Details are covered in the UPDATING.md files for each library, but there are some details that you should pay attention to.
| Library name | Previous constraints | Current constraints | |
|---|---|---|---|
google-cloud-automl |
>=0.4.0,<2.0.0 |
>=2.1.0,<3.0.0 |
UPGRADING.md |
google-cloud-bigquery-datatransfer |
>=0.4.0,<2.0.0 |
>=3.0.0,<4.0.0 |
UPGRADING.md |
google-cloud-datacatalog |
>=0.5.0,<0.8 |
>=3.0.0,<4.0.0 |
UPGRADING.md |
google-cloud-dataproc |
>=1.0.1,<2.0.0 |
>=2.2.0,<3.0.0 |
UPGRADING.md |
google-cloud-kms |
>=1.2.1,<2.0.0 |
>=2.0.0,<3.0.0 |
UPGRADING.md |
google-cloud-logging |
>=1.14.0,<2.0.0 |
>=2.0.0,<3.0.0 |
UPGRADING.md |
google-cloud-monitoring |
>=0.34.0,<2.0.0 |
>=2.0.0,<3.0.0 |
UPGRADING.md |
google-cloud-os-login |
>=1.0.0,<2.0.0 |
>=2.0.0,<3.0.0 |
UPGRADING.md |
google-cloud-pubsub |
>=1.0.0,<2.0.0 |
>=2.0.0,<3.0.0 |
UPGRADING.md |
google-cloud-tasks |
>=1.2.1,<2.0.0 |
>=2.0.0,<3.0.0 |
UPGRADING.md |
The field names use the snake_case convention
If your DAG uses an object from the above mentioned libraries passed by XCom, it is necessary to update the naming convention of the fields that are read. Previously, the fields used the CamelSnake convention, now the snake_case convention is used.
Before:
set_acl_permission = GCSBucketCreateAclEntryOperator(
task_id="gcs-set-acl-permission",
bucket=BUCKET_NAME,
entity="user-{{ task_instance.xcom_pull('get-instance')['persistenceIamIdentity']"
".split(':', 2)[1] }}",
role="OWNER",
)
After:
set_acl_permission = GCSBucketCreateAclEntryOperator(
task_id="gcs-set-acl-permission",
bucket=BUCKET_NAME,
entity="user-{{ task_instance.xcom_pull('get-instance')['persistence_iam_identity']"
".split(':', 2)[1] }}",
role="OWNER",
)
Features
Add Apache Beam operators (#12814)Add Google Cloud Workflows Operators (#13366)Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)Add How To Guide for Dataflow (#13461)Generalize MLEngineStartTrainingJobOperator to custom images (#13318)Add Parquet data type to BaseSQLToGCSOperator (#13359)Add DataprocCreateWorkflowTemplateOperator (#13338)Add OracleToGCS Transfer (#13246)Add timeout option to gcs hook methods. (#13156)Add regional support to dataproc workflow template operators (#12907)Add project_id to client inside BigQuery hook update_table method (#13018)
Bug fixes
Fix four bugs in StackdriverTaskHandler (#13784)Decode Remote Google Logs (#13115)Fix and improve GCP BigTable hook and system test (#13896)updated Google DV360 Hook to fix SDF issue (#13703)Fix insert_all method of BigQueryHook to support tables without schema (#13138)Fix Google BigQueryHook method get_schema() (#13136)Fix Data Catalog operators (#13096)
Installation
You can install this package on top of an existing airflow 1.10.* installation via
pip install apache-airflow-backport-providers-google
PIP requirements
| PIP package | Version required |
|---|---|
PyOpenSSL |
|
google-ads |
>=4.0.0,<8.0.0 |
google-api-core |
>=1.25.1,<2.0.0 |
google-api-python-client |
>=1.6.0,<2.0.0 |
google-auth-httplib2 |
>=0.0.1 |
google-auth |
>=1.0.0,<2.0.0 |
google-cloud-automl |
>=2.1.0,<3.0.0 |
google-cloud-bigquery-datatransfer |
>=3.0.0,<4.0.0 |
google-cloud-bigtable |
>=1.0.0,<2.0.0 |
google-cloud-container |
>=0.1.1,<2.0.0 |
google-cloud-datacatalog |
>=3.0.0,<4.0.0 |
google-cloud-dataproc |
>=2.2.0,<3.0.0 |
google-cloud-dlp |
>=0.11.0,<2.0.0 |
google-cloud-kms |
>=2.0.0,<3.0.0 |
google-cloud-language |
>=1.1.1,<2.0.0 |
google-cloud-logging |
>=2.1.1,<3.0.0 |
google-cloud-memcache |
>=0.2.0 |
google-cloud-monitoring |
>=2.0.0,<3.0.0 |
google-cloud-os-login |
>=2.0.0,<3.0.0 |
google-cloud-pubsub |
>=2.0.0,<3.0.0 |
google-cloud-redis |
>=2.0.0,<3.0.0 |
google-cloud-secret-manager |
>=0.2.0,<2.0.0 |
google-cloud-spanner |
>=1.10.0,<2.0.0 |
google-cloud-speech |
>=0.36.3,<2.0.0 |
google-cloud-storage |
>=1.30,<2.0.0 |
google-cloud-tasks |
>=2.0.0,<3.0.0 |
google-cloud-texttospeech |
>=0.4.0,<2.0.0 |
google-cloud-translate |
>=1.5.0,<2.0.0 |
google-cloud-videointelligence |
>=1.7.0,<2.0.0 |
google-cloud-vision |
>=0.35.2,<2.0.0 |
google-cloud-workflows |
>=0.1.0,<2.0.0 |
grpcio-gcp |
>=0.2.2 |
json-merge-patch |
~=0.2 |
pandas-gbq |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-backport-providers-google[amazon]
| Dependent package | Extra |
|---|---|
| apache-airflow-backport-providers-amazon | amazon |
| apache-airflow-backport-providers-apache-beam | apache.beam |
| apache-airflow-backport-providers-apache-cassandra | apache.cassandra |
| apache-airflow-backport-providers-cncf-kubernetes | cncf.kubernetes |
| apache-airflow-backport-providers-facebook | facebook |
| apache-airflow-backport-providers-microsoft-azure | microsoft.azure |
| apache-airflow-backport-providers-microsoft-mssql | microsoft.mssql |
| apache-airflow-backport-providers-mysql | mysql |
| apache-airflow-backport-providers-oracle | oracle |
| apache-airflow-backport-providers-postgres | postgres |
| apache-airflow-backport-providers-presto | presto |
| apache-airflow-backport-providers-salesforce | salesforce |
| apache-airflow-backport-providers-sftp | sftp |
| apache-airflow-backport-providers-ssh | ssh |
Provider classes summary
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the google provider
are in the airflow.providers.google package. You can read more about the naming conventions used
in Naming conventions for provider packages
Operators
New operators
Moved operators
Transfer operators
New transfer operators
Moved transfer operators
Sensors
New sensors
Moved sensors
Hooks
New hooks
Moved hooks
Secrets
Moved secrets
Airflow 2.0 secrets: airflow.providers.google package |
Airflow 1.10.* previous location (usually airflow.contrib) |
|---|---|
| cloud.secrets.secret_manager.CloudSecretManagerBackend | contrib.secrets.gcp_secrets_manager.CloudSecretsManagerBackend |
Releases
Release 2021.3.3
| Commit | Committed | Subject |
|---|---|---|
| 50a1504c5 | 2021-02-27 | Fix spellings (#14483) |
| bfef559cf | 2021-02-27 | Corrects order of argument in docstring in GCSHook.download method (#14497) |
| 33214d932 | 2021-02-26 | Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677) |
| c28197998 | 2021-02-23 | Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033) |
| ca35bd7f7 | 2021-02-21 | By default PIP will install all packages in .local folder (#14125) |
| a7e4266d6 | 2021-02-21 | Refactor GoogleDriveToGCSOperator to use common methods (#14276) |
| 1ab406663 | 2021-02-16 | Add GoogleDriveToLocalOperator (#14191) |
| 59c94c679 | 2021-02-13 | Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026) |
| e31b27d59 | 2021-02-13 | Add materialized view support for BigQuery (#14201) |
| e3bcaa3ba | 2021-02-12 | Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179) |
| 7faa2d978 | 2021-02-10 | Add BigQueryUpdateTableOperator (#14149) |
| 1da697216 | 2021-02-10 | Fixes to dataproc operators and hook (#14086) |
| 02288cf2b | 2021-02-10 | Add param to CloudDataTransferServiceOperator (#14118) |
| 7d3864547 | 2021-02-09 | #9803 fix bug in copy operation without wildcard (#13919) |
| b0c382426 | 2021-02-07 | Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982) |
| 5d7d46bb3 | 2021-02-05 | Improve GCSToSFTPOperator paths handling (#11284) |
| 10343ec29 | 2021-02-05 | Corrections in docs and tools after releasing provider RCs (#14082) |
Release 2021.2.5
| Commit | Committed | Subject |
|---|---|---|
| 88bdcfa0d | 2021-02-04 | Prepare to release a new wave of providers. (#14013) |
| 1872d8719 | 2021-02-03 | Add Apache Beam operators (#12814) |
| 0e8c77b93 | 2021-02-03 | Support google-cloud-logging' >=2.0.0 (#13801) |
| 833e33832 | 2021-02-02 | Fix four bugs in StackdriverTaskHandler (#13784) |
| d2efb3323 | 2021-02-02 | Support google-cloud-monitoring>=2.0.0 (#13769) |
| ac2f72c98 | 2021-02-01 | Implement provider versioning tools (#13767) |
| 823741cfe | 2021-01-28 | Improve GCS system test envs (#13946) |
| 6d6588fe2 | 2021-01-28 | Add Google Cloud Workflows Operators (#13366) |
| 810c15ed8 | 2021-01-27 | Fix and improve GCP BigTable hook and system test (#13896) |
| 661661733 | 2021-01-27 | Add env variables to PubSub example dag (#13794) |
| f473ca713 | 2021-01-24 | Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851) |
| a9ac2b040 | 2021-01-23 | Switch to f-strings using flynt. (#13732) |
| 9592be88e | 2021-01-22 | Fix Google Spanner example dag (#13842) |
| af52fdb51 | 2021-01-22 | Improve environment variables in GCP Dataflow system test (#13841) |
| e7946f1cb | 2021-01-22 | Improve environment variables in GCP Datafusion system test (#13837) |
| 61c1d6ec6 | 2021-01-22 | Improve environment variables in GCP Memorystore system test (#13833) |
| 202f66093 | 2021-01-22 | Improve environment variables in GCP Lifeciences system test (#13834) |
| 70bf307f3 | 2021-01-21 | Add How To Guide for Dataflow (#13461) |
| 3fd5ef355 | 2021-01-21 | Add missing logos for integrations (#13717) |
| 309788e5e | 2021-01-18 | Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256) |
| 7ec858c45 | 2021-01-17 | updated Google DV360 Hook to fix SDF issue (#13703) |
| ef8617ec9 | 2021-01-14 | Support google-cloud-tasks>=2.0.0 (#13347) |
| 189af5404 | 2021-01-13 | Add system tests for Stackdriver operators (#13644) |
| a6f999b62 | 2021-01-11 | Support google-cloud-automl >=2.1.0 (#13505) |
| 947dbb73b | 2021-01-11 | Support google-cloud-datacatalog>=3.0.0 (#13534) |
| 2fb68342b | 2021-01-07 | Replace deprecated module and operator in example_tasks.py (#13527) |
| 003584bbf | 2021-01-05 | Fix failing backport packages test (#13497) |
| 7d1ea4cb1 | 2021-01-05 | Replace deprecated module and operator in example_tasks.py (#13473) |
| c7d75ad88 | 2021-01-05 | Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482) |
| feb84057d | 2021-01-04 | Support google-cloud-datacatalog 3.0.0 (#13224) |
| 3a3e73998 | 2021-01-04 | Fix insert_all method of BigQueryHook to support tables without schema (#13138) |
| c33d2c06b | 2021-01-02 | Fix another pylint c-extension-no-member (#13438) |
| f6518dd6a | 2021-01-02 | Generalize MLEngineStartTrainingJobOperator to custom images (#13318) |
| 9de712708 | 2020-12-31 | Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337) |
| 406181d64 | 2020-12-31 | Add Parquet data type to BaseSQLToGCSOperator (#13359) |
| 295d66f91 | 2020-12-30 | Fix Grammar in PIP warning (#13380) |
| 13a9747bf | 2020-12-28 | Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341) |
| 04ec45f04 | 2020-12-28 | Add DataprocCreateWorkflowTemplateOperator (#13338) |
| 1f712219f | 2020-12-28 | Support google-cloud-tasks>=2.0.0 (#13334) |
| f4745c8ce | 2020-12-26 | Fix typo in example (#13321) |
| e9d65bd45 | 2020-12-24 | Decode Remote Google Logs (#13115) |
| e7aeacf33 | 2020-12-24 | Add OracleToGCS Transfer (#13246) |
| 323084e97 | 2020-12-24 | Add timeout option to gcs hook methods. (#13156) |
| 0b626c804 | 2020-12-22 | Support google-cloud-redis>=2.0.0 (#13117) |
| 9042a5855 | 2020-12-22 | Add more operators to example DAGs for Cloud Tasks (#13235) |
| 8c00ec89b | 2020-12-22 | Support google-cloud-pubsub>=2.0.0 (#13127) |
| b26b0df5b | 2020-12-22 | Update compatibility with google-cloud-kms>=2.0 (#13124) |
| 9a1d3820d | 2020-12-22 | Support google-cloud-datacatalog>=1.0.0 (#13097) |
| f95b1c9c9 | 2020-12-21 | Add regional support to dataproc workflow template operators (#12907) |
| 6cf76d7ac | 2020-12-18 | Fix typo in pip upgrade command :( (#13148) |
| 23f27c1b1 | 2020-12-18 | Add system tests for CloudKMSHook (#13122) |
| cddbf81b1 | 2020-12-17 | Fix Google BigQueryHook method get_schema() (#13136) |
| 1259c712a | 2020-12-17 | Update compatibility with google-cloud-os-login>=2.0.0 (#13126) |
| bcf77586e | 2020-12-16 | Fix Data Catalog operators (#13096) |
| 5090fb0c8 | 2020-12-15 | Add script to generate integrations.json (#13073) |
| b4b9cf559 | 2020-12-14 | Check for missing references to operator guides (#13059) |
| 1c1ef7ee6 | 2020-12-14 | Add project_id to client inside BigQuery hook update_table method (#13018) |
| 32971a1a2 | 2020-12-09 | Updates providers versions to 1.0.0 (#12955) |
| b40dffa08 | 2020-12-08 | Rename remaing modules to match AIP-21 (#12917) |
| 9b39f2478 | 2020-12-08 | Add support for dynamic connection form fields per provider (#12558) |
| 1dcd3e13f | 2020-12-05 | Add support for extra links coming from the providers (#12472) |
| 2037303ee | 2020-11-29 | Adds support for Connection/Hook discovery from providers (#12466) |
| 02d94349b | 2020-11-29 | Don't use time.time() or timezone.utcnow() for duration calculations (#12353) |
| 76bcd08dc | 2020-11-28 | Added '@apply_defaults' decorator. (#12620) |
| e1ebfa68b | 2020-11-27 | Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249) |
| 3fa51f94d | 2020-11-24 | Add check for duplicates in provider.yaml files (#12578) |
| c34ef853c | 2020-11-20 | Separate out documentation building per provider (#12444) |
| 9e3b2c554 | 2020-11-19 | GCP Secrets Optional Lookup (#12360) |
| 008035450 | 2020-11-18 | Update provider READMEs for 1.0.0b2 batch release (#12449) |
| 7ca0b6f12 | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438) |
| 8d0950646 | 2020-11-18 | Fix download method in GCSToBigQueryOperator (#12442) |
Release 2020.11.23
| Commit | Committed | Subject |
|---|---|---|
| 4873d9759 | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
| 8d0950646 | 2020-11-18 | Fix download method in GCSToBigQueryOperator (#12442) |
| 2c0920fba | 2020-11-17 | Adds mechanism for provider package discovery. (#12383) |
| 2cda2f2a0 | 2020-11-17 | Add missing pre-commit definition - provider-yamls (#12393) |
| 80a957f14 | 2020-11-17 | Add Dataflow sensors - job metrics (#12039) |
| ae7cb4a1e | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
| 917e6c442 | 2020-11-16 | Add provide_file_and_upload to GCSHook (#12310) |
| cfa4ecfeb | 2020-11-15 | Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726) |
| 6889a333c | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
| 7825e8f59 | 2020-11-13 | Docs installation improvements (#12304) |
| 32b59f835 | 2020-11-12 | Fixes the sending of an empty list to BigQuery list_rows (#12307) |
| 250436d96 | 2020-11-10 | Fix spelling in Python files (#12230) |
| 502ba309e | 2020-11-10 | Enable Markdownlint rule - MD022/blanks-around-headings (#12225) |
| dd2095f4a | 2020-11-10 | Simplify string expressions & Use f-string (#12216) |
| f37c6e6fc | 2020-11-10 | Add Compute Engine SSH hook (#9879) |
| 85a18e13d | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
| 59eb5de78 | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
| 61feb6ec4 | 2020-11-09 | Provider's readmes generated for elasticsearch and google packages (#12194) |
Release 2020.11.13
| Commit | Committed | Subject |
|---|---|---|
| b2a28d159 | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
| fcb6b00ef | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
| 2ef3b7ef8 | 2020-11-08 | Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172) |
| 0caec9fd3 | 2020-11-06 | Dataflow - add waiting for successful job cancel (#11501) |
| cf9437d79 | 2020-11-06 | Simplify string expressions (#12123) |
| 91a64db50 | 2020-11-04 | Format all files (without excepions) by black (#12091) |
| fd3db778e | 2020-11-04 | Add server side cursor support for postgres to GCS operator (#11793) |
| f1f194026 | 2020-11-04 | Add DataflowStartSQLQuery operator (#8553) |
| 41bf172c1 | 2020-11-04 | Simplify string expressions (#12093) |
| 5f5244b74 | 2020-11-04 | Add template fields renderers to Biguery and Dataproc operators (#12067) |
| 4e8f9cc8d | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
| 8c42cf1b0 | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
| 45ae145c2 | 2020-11-03 | Log BigQuery job id in insert method of BigQueryHook (#12056) |
| e324b37a6 | 2020-11-03 | Add job name and progress logs to Cloud Storage Transfer Hook (#12014) |
| 6071fdd58 | 2020-11-02 | Improve handling server errors in DataprocSubmitJobOperator (#11947) |
| 2f703df12 | 2020-10-30 | Add SalesforceToGcsOperator (#10760) |
| e5713e00b | 2020-10-29 | Add drain option when canceling Dataflow pipelines (#11374) |
| 37eaac3c5 | 2020-10-29 | The PRs which are not approved run subset of tests (#11828) |
| 79cb77199 | 2020-10-28 | Fixing re pattern and changing to use a single character class. (#11857) |
| 5a439e84e | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
| 240c7d4d7 | 2020-10-26 | Google Memcached hooks - improve protobuf messages handling (#11743) |
| 8afdb6ac6 | 2020-10-26 | Fix spellings (#11825) |
| 872b1566a | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
| b680bbc0b | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
Release 2020.10.29
| Commit | Committed | Subject |
|---|---|---|
| b680bbc0b | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
| 6ce855af1 | 2020-10-24 | Fix spelling (#11821) |
| 483068745 | 2020-10-24 | Use Python 3 style super classes (#11806) |
| 727c739af | 2020-10-22 | Improve Cloud Memorystore for Redis example (#11735) |
| 1da8379c9 | 2020-10-22 | Fix static checks after merging #10121 (#11737) |
| 91503308c | 2020-10-22 | Add Google Cloud Memorystore Memcached Operators (#10121) |
| 950c16d0b | 2020-10-21 | Retry requests in case of error in Google ML Engine Hook (#11712) |
| 2bfc53b5e | 2020-10-21 | Fix doc errors in google provider files. (#11713) |
| 53e606210 | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
| 349b0811c | 2020-10-20 | Add D200 pydocstyle check (#11688) |
| 2d854c350 | 2020-10-19 | Add service_account to Google ML Engine operator (#11619) |
| 46a121fb7 | 2020-10-18 | docs: Update Bigquery clustering docstrings (#11232) |
| 49c58147f | 2020-10-18 | Strict type checking for provider Google (#11609) |
| 0823d46a7 | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
| 3c10ca650 | 2020-10-16 | Add DataflowStartFlexTemplateOperator (#8550) |
| 8865d14df | 2020-10-16 | Strict type checking for provider google cloud (#11548) |
| 16e712971 | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
| 06141d6d0 | 2020-10-12 | Google cloud operator strict type check (#11450) |
| d305876be | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
| 1845cd11b | 2020-10-11 | Strict type check for google ads and cloud hooks (#11390) |
| bd204bb91 | 2020-10-11 | Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) |
| 75071831b | 2020-10-10 | Remove redundant parentheses from Python files (#10967) |
| 8baf657fc | 2020-10-09 | Fix regression in DataflowTemplatedJobStartOperator (#11167) |
| b0fcf6755 | 2020-10-07 | Add AzureFileShareToGCSOperator (#10991) |
| 47b05a87f | 2020-10-07 | Improve handling of job_id in BigQuery operators (#11287) |
| 0a0e1af80 | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
Release 2020.10.5
| Commit | Committed | Subject |
|---|---|---|
| ca4238eb4 | 2020-10-02 | Fixed month in backport packages to October (#11242) |
| 5220e4c38 | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
| cb52fb0ae | 2020-09-27 | Add example DAG and system test for MySQLToGCSOperator (#10990) |
| 99accec29 | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
| e3f96ce7a | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
| daf8f3108 | 2020-09-23 | Add template fields renderers for better UI rendering (#11061) |
| f3e87c503 | 2020-09-22 | Add D202 pydocstyle check (#11032) |
| cb979f9f2 | 2020-09-22 | Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024) |
| 76545bb3d | 2020-09-16 | Add example dag and system test for S3ToGCSOperator (#10951) |
| 22c631625 | 2020-09-16 | Fix more docs spellings (#10965) |
| 12a652f53 | 2020-09-13 | Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869) |
| 41a62735e | 2020-09-11 | Add on_kill method to BigQueryInsertJobOperator (#10866) |
| 3e91da56e | 2020-09-11 | fix typo in firebase/example_filestore DAG (#10875) |
| 68cc7273b | 2020-09-10 | Add on_kill method to DataprocSubmitJobOperator (#10847) |
| f92095721 | 2020-09-10 | Fix and remove some more typos from spelling_wordlist.txt (#10845) |
| 9549274d1 | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
| 078bfaf60 | 2020-09-08 | Extract missing gcs_to_local example DAG from gcs example (#10767) |
| 10ce31127 | 2020-09-08 | Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) |
| f14f37971 | 2020-09-07 | [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) |
| c8ee45568 | 2020-09-07 | Refactor DataprocCreateCluster operator to use simpler interface (#10403) |
| ece685b5b | 2020-09-05 | Asynchronous execution of Dataproc jobs with a Sensor (#10673) |
| 6e3d7b63d | 2020-09-04 | Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578) |
| 804548d58 | 2020-09-01 | Add Dataprep operators (#10304) |
| 11c00bc82 | 2020-08-30 | Fix typos: duplicated "the" (#10647) |
| 2ca615cff | 2020-08-29 | Update Google Cloud branding (#10642) |
| 1b533f617 | 2020-08-28 | Fix broken master - DLP (#10635) |
| 5ae82a56d | 2020-08-28 | Fix Google DLP example and improve ops idempotency (#10608) |
| 3867f7662 | 2020-08-28 | Update Google Cloud branding (#10615) |
| 91ff31ad1 | 2020-08-27 | Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) |
| fdd9b6f65 | 2020-08-25 | Enable Black on Providers Packages (#10543) |
| d76026545 | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
| d1bce91bb | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
| 866701c80 | 2020-08-25 | Fix typo in "Cloud" (#10534) |
| 47265e7b5 | 2020-08-24 | Fix typo in PostgresHook (#10529) |
| 3696c34c2 | 2020-08-24 | Fix typo in the word "release" (#10528) |
| 2f2d8dbfa | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
| 3734876d9 | 2020-08-24 | Implement impersonation in google operators (#10052) |
| b0598b535 | 2020-08-24 | Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475) |
| ee7ca128a | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
| 515cc72c9 | 2020-08-22 | Fix typo in timed_out (#10459) |
| 7c206a82a | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
| 88c7d2e52 | 2020-08-21 | Dataflow operators don't not always create a virtualenv (#10373) |
| 083c3c129 | 2020-08-18 | Simplified GCSTaskHandler configuration (#10365) |
| 1ae5bdf23 | 2020-08-17 | Add test for GCSTaskHandler (#9600) (#9861) |
| e195a980b | 2020-08-16 | Add type annotations for mlengine_operator_utils (#10297) |
| 382c1011b | 2020-08-16 | Add Bigtable Update Instance Hook/Operator (#10340) |
| bfa5a8d5f | 2020-08-15 | CI: Fix failing docs-build (#10342) |
| be46d20fb | 2020-08-15 | Improve idempotency of BigQueryInsertJobOperator (#9590) |
| 47387a69e | 2020-08-14 | Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326) |
| 2f0613b0c | 2020-08-13 | Implement Google BigQuery Table Partition Sensor (#10218) |
| f6734b3b8 | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
| 8f8db8959 | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
| ef088314f | 2020-08-09 | Added DataprepGetJobsForJobGroupOperator (#10246) |
| b43f90abf | 2020-08-09 | Fix various typos in the repo (#10263) |
| c29533888 | 2020-08-08 | Add labels param to Google MLEngine Operators (#10222) |
| cdec30125 | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
| eff0f0321 | 2020-08-06 | Update guide for Google Cloud Secret Manager Backend (#10172) |
| 24c8e4c2d | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
| 010322692 | 2020-08-06 | Improve handling Dataproc cluster creation with ERROR state (#9593) |
| 1437cb749 | 2020-08-04 | Add correct signatures for operators in google provider package (#10144) |
| 6efa1b9cb | 2020-08-03 | Add additional Cloud Datastore operators (#10032) |
| 27020f8e5 | 2020-08-03 | Add try clause to DataFusionHook.wait_for_pipeline_state (#10031) |
| 4e3799fec | 2020-08-02 | [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117) |
| 85c56b173 | 2020-08-02 | Add missing params to GCP Pub/Sub creation_subscription (#10106) |
| b79466c12 | 2020-08-02 | Fix sensor not providing arguments for GCSHook (#10074) |
| 4ee35d027 | 2020-08-02 | Fix hook not passing gcp_conn_id to base class (#10075) |
| aeea71274 | 2020-08-02 | Remove args parameter from provider operator constructors (#10097) |
| 4c84661ad | 2020-07-31 | Split Display Video 360 example into smaler DAGs (#10077) |
| 59cbff087 | 2020-07-29 | Fix docstrings in BigQueryGetDataOperator (#10042) |
| 81b87d48e | 2020-07-27 | Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996) |
| 7d24b088c | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
| 8b10a4b35 | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
| ef98edf4d | 2020-07-23 | Add more information about using GoogleAdsHook (#9951) |
| 33f0cd265 | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
| 39a0288a4 | 2020-07-22 | Add Google Authentication for experimental API (#9848) |
| c2db0dfeb | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
| c4244e18b | 2020-07-22 | Fix calling get_client in BigQueryHook.table_exists (#9916) |
| 5eacc1642 | 2020-07-22 | Add support for impersonation in GCP hooks (#9915) |
| 1cfdebf5f | 2020-07-21 | Fix insert_job method of BigQueryHook (#9899) |
| c8c52e69c | 2020-07-21 | Remove type hint causing DeprecationWarning in Firestore operators (#9819) |
| eb6f1d1cf | 2020-07-16 | Fix typo in datafusion operator (#9859) |
| b01d95ec2 | 2020-07-15 | Change DAG.clear to take dag_run_state (#9824) |
| 6d65c15d1 | 2020-07-15 | Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798) |
| 770de53eb | 2020-07-15 | BigQueryTableExistenceSensor needs to specify keyword arguments (#9832) |
| 2d8dbacdf | 2020-07-15 | Add CloudVisionDeleteReferenceImageOperator (#9698) |
| 9f017951b | 2020-07-15 | Add Google Deployment Manager Hook (#9159) |
| ed5004cca | 2020-07-14 | Allow replace flag in gcs_to_gcs operator. (#9667) |
| 553bb7af7 | 2020-07-13 | Keep functions signatures in decorators (#9786) |
| 68925904e | 2020-07-13 | Add multiple file upload functionality to GCS hook (#8849) |
| 1de78e8f9 | 2020-07-12 | Add Google Stackdriver link (#9765) |
| 092d33f29 | 2020-07-11 | Fix StackdriverTaskHandler + add system tests (#9761) |
| b2305660f | 2020-07-09 | Update example DAG for AI Platform operators (#9727) |
| 23f80f34a | 2020-07-08 | Move gcs & wasb task handlers to their respective provider packages (#9714) |
| 44d4ae809 | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
| a79e2d4c4 | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
| cd3d9d934 | 2020-07-02 | Fix using .json template extension in GMP operators (#9566) |
| 4799af30e | 2020-06-30 | Extend BigQuery example with include clause (#9572) |
| e33f1a12d | 2020-06-30 | Add template_ext to BigQueryInsertJobOperator (#9568) |
| 40add26d4 | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
| c420dbd6e | 2020-06-27 | Bump Pylint to 2.5.3 (#9294) |
| 0051c89cb | 2020-06-26 | nitpick fix (#9527) |
| 87fdbd070 | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
| 7256f4caa | 2020-06-22 | Pylint fixes and deprecation of rare used methods in Connection (#9419) |
| e13a14c87 | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
| 5b680e27e | 2020-06-19 | Don't use connection to store task handler credentials (#9381) |
| d0e7db402 | 2020-06-19 | Fixed release number for fresh release (#9408) |
Release 2020.6.24
| Commit | Committed | Subject |
|---|---|---|
| 416334e2e | 2020-06-19 | Properly propagated warnings in operators (#9348) |
| 12af6a080 | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
| c7e5bce57 | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
| 4e09c6442 | 2020-06-18 | Adds GCP Secret Manager Hook (#9368) |
| 40bf8f28f | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
| f6bd817a3 | 2020-06-16 | Introduce 'transfers' packages (#9320) |
| 639972d99 | 2020-06-16 | Add support for latest Apache Beam SDK in Dataflow operators (#9323) |
| 1459970b3 | 2020-06-15 | Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314) |
| 431ea3291 | 2020-06-15 | Resolve upstream tasks when template field is XComArg (#8805) |
| aee6ab94e | 2020-06-15 | Wait for pipeline state in Data Fusion operators (#8954) |
| fb1c8b83d | 2020-06-10 | Add test for BQ operations using location (#9206) |
| a26afbfa5 | 2020-06-10 | Make generated job_id more informative in BQ insert_job (#9203) |
| c41192fa1 | 2020-06-10 | Upgrade pendulum to latest major version ~2.0 (#9184) |
| b1c8c5ed5 | 2020-06-09 | Allows using private endpoints in GKEStartPodOperator (#9169) |
| 5918efc86 | 2020-06-05 | Add 3.8 to the test matrices (#8836) |
| 9bcdadaf7 | 2020-06-05 | Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154) |
| f56811dff | 2020-06-05 | [AIRFLOW-6290] Create guide for GKE operators (#8883) |
| 76962867b | 2020-06-04 | Fix sql_to_gcs hook gzip of schema_file (#9140) |
| 17adcea83 | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
| 789852546 | 2020-06-01 | Add BigQueryInsertJobOperator (#8868) |
| 29eb68b90 | 2020-05-31 | Create guide for Dataproc Operators (#9037) |
| 886afaf62 | 2020-05-29 | Add example dag and system test for LocalFilesystemToGCSOperator (#9043) |
| a779c4dfc | 2020-05-29 | add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066) |
| ada26be23 | 2020-05-29 | Add correct description for dst param in LocalFilesystemToGCSOperator (#9055) |
| 81b2761b8 | 2020-05-29 | add example dag and system test for GoogleSheetsToGCSOperator (#9056) |
| 0b0e4f7a4 | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
| 00642a46d | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
| 3994030ea | 2020-05-26 | Refactor BigQuery operators (#8858) |
| cdb3f2545 | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
| 1d36b0303 | 2020-05-23 | Fix references in docs (#8984) |
| cf5cf45e1 | 2020-05-23 | Support YAML input for CloudBuildCreateOperator (#8808) |
| 499493c5c | 2020-05-19 | [AIRFLOW-6586] Improvements to gcs sensor (#7197) |
| 375d1ca22 | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
| 841d81664 | 2020-05-19 | Allow setting the pooling time in DLPHook (#8824) |
| 12c5e5d8a | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
| f3521fb0e | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
| 15273f0ea | 2020-05-16 | Check for same task instead of Equality to detect Duplicate Tasks (#8828) |
| 92585ca4c | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
| e1e833bb2 | 2020-05-13 | Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816) |
| 8b5491971 | 2020-05-12 | Refactor BigQuery hook methods to use python library (#8631) |
| 6911dfe83 | 2020-05-12 | Fix template fields in Google operators (#8840) |
| 4b06fde0f | 2020-05-12 | Fix Flake8 errors (#8841) |
| 1d12c347c | 2020-05-12 | Refactor BigQuery check operators (#8813) |
| 493b685d7 | 2020-05-10 | Add separate example DAGs and system tests for google cloud speech (#8778) |
| 79ef8bed8 | 2020-05-10 | Added Upload Multiple Entity Read Files to specified big query dataset (#8610) |
| 280f1f0c4 | 2020-05-10 | Correctly restore upstream_task_ids when deserializing Operators (#8775) |
| 58aefb23b | 2020-05-08 | Added SDFtoGCSOperator (#8740) |
| 723c52c94 | 2020-05-07 | Add documentation for SpannerDeployInstanceOperator (#8750) |
| 25ee4211b | 2020-05-06 | Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531) |
| 8d6f1aa4b | 2020-05-05 | Support num_retries field in env var for GCP connection (#8700) |
| 67caae0f2 | 2020-05-04 | Add system test for gcs_to_bigquery (#8556) |
| bc45fa675 | 2020-05-03 | Add system test and docs for Facebook Ads operators (#8503) |
| a28c66f23 | 2020-04-30 | [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625) |
| 992a24ce4 | 2020-04-28 | Split and improve BigQuery example DAG (#8529) |
| c1fb28230 | 2020-04-28 | Refactor BigQueryHook dataset operations (#8477) |
| e8d0f8fea | 2020-04-26 | Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430) |
| 37fdfa977 | 2020-04-26 | [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442) |
| 14b22e6ff | 2020-04-25 | Add hook and operator for Google Cloud Life Sciences (#8481) |
| 72ddc94d1 | 2020-04-23 | Pass location using parmamter in Dataflow integration (#8382) |
| 912aa4b42 | 2020-04-23 | Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174) |
| 57c8c0583 | 2020-04-22 | Use python client in BQ hook create_empty_table/dataset and table_exists (#8377) |
| 5d3a7eef3 | 2020-04-20 | Allow multiple extra_packages in Dataflow (#8394) |
| 79c99b1b6 | 2020-04-18 | Added location parameter to BigQueryCheckOperator (#8273) |
| 79d3f33c1 | 2020-04-17 | Clean up temporary files in Dataflow operators (#8313) |
| efcffa323 | 2020-04-16 | Add Dataproc SparkR Example (#8240) |
| b198a1fa9 | 2020-04-15 | Create guide for BigQuery operators (#8276) |
| 2636cc932 | 2020-04-14 | Raise exception when GCP credential doesn't support account impersonation (#8213) |
| eee4ebaee | 2020-04-14 | Added Facebook Ads Operator #7887 (#8008) |
| 8cae07ea1 | 2020-04-14 | fixed typo (#8294) |
| 45c898330 | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
| 1fd9ed384 | 2020-04-13 | Add mypy plugin for decorators. (#8145) |
| 327b0a9f7 | 2020-04-13 | Added GoogleDisplayVideo360UploadLineItemsOperator (#8216) |
| bb5e403a3 | 2020-04-10 | Honor schema type for MySQL to GCS data pre-process (#8090) |
| 87969a350 | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
| 3fc89f29f | 2020-04-06 | [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849) |
| 7ef75d239 | 2020-04-03 | [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049) |
| ed2bc0057 | 2020-04-02 | Add Google Ads list accounts operator (#8007) |
| 3808a6206 | 2020-04-01 | Unify Google class/package names (#8033) |
| 8a0240257 | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
| 8e8978007 | 2020-03-31 | Add more refactor steps for providers.google (#8010) |
| aae3b8fb2 | 2020-03-31 | Individual package READMEs (#8012) |
| 779023968 | 2020-03-30 | [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743) |
| 49abce521 | 2020-03-30 | Improve system tests for Cloud Build (#8003) |
| 0f19a930d | 2020-03-29 | Remove GKEStartPodOperator when backporting (#7908) |
| 0e1c238b2 | 2020-03-28 | Get Airflow Variables from GCP Secrets Manager (#7946) |
| eb4af4f94 | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
| 01f99426f | 2020-03-28 | Add download/upload operators for GCS and Google Sheets (#7866) |
| 892522f8e | 2020-03-26 | Change signature of GSheetsHook methods (#7853) |
| bfd425157 | 2020-03-26 | Improve idempotency in MLEngineHook.create_model (#7811) |
| f9c226343 | 2020-03-26 | Fix CloudSecretsManagerBackend invalid connections_prefix (#7861) |
| e3920f12f | 2020-03-26 | Improve setUp/tearDown in Cloud Firestore system test (#7862) |
| 8ba8a7295 | 2020-03-26 | Improve example DAGs for Cloud Memorystore (#7855) |
| f7d1a437c | 2020-03-26 | Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856) |
| beef6c230 | 2020-03-26 | Improve authorization in GCP system tests (#7863) |
| 5f165f3e4 | 2020-03-26 | [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869) |
| 686d7d50b | 2020-03-25 | Standardize SecretBackend class names (#7846) |
| 1982c3fdc | 2020-03-24 | Run Dataflow for ML Engine summary in venv (#7809) |
| eef87b995 | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
| 529db07b2 | 2020-03-23 | Improve Google PubSub hook publish method (#7831) |
| 4bde99f13 | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
| a001489b5 | 2020-03-23 | Improve example DAG for ML Engine (#7810) |
| 9e5a8e7f8 | 2020-03-23 | Add call to Super class in 'google' providers (#7823) |
| b86bf79bf | 2020-03-23 | Fix typo in GCP credentials_provider's docstring (#7818) |
| 56c013ce9 | 2020-03-23 | Add missing docstring in BigQueryHook.create_empty_table (#7817) |
| 426a79847 | 2020-03-23 | Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812) |
| cdf1809fc | 2020-03-23 | [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795) |
| 27dac00e1 | 2020-03-22 | [AIRFLOW-7099] Improve system test for cloud transfer service (#7794) |
| 0daf5d729 | 2020-03-22 | Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791) |
| c8088c2bd | 2020-03-20 | [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781) |
| 5106a2931 | 2020-03-20 | [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748) |
| 759ce2a80 | 2020-03-20 | [AIRFLOW-6978] Add PubSubPullOperator (#7766) |
| 6b9b214e4 | 2020-03-20 | [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692) |
| b11891696 | 2020-03-19 | [AIRFLOW-7069] Fix cloudsql system tests (#7770) |
| ae854cae5 | 2020-03-19 | [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756) |
| 7e1e954d2 | 2020-03-19 | [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759) |
| 6e21c139b | 2020-03-19 | [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762) |
| ce022a3f7 | 2020-03-19 | [AIRFLOW-XXXX] Add cross-references for operators guide (#7760) |
| 029c84e55 | 2020-03-18 | [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718) |
| 63a3102ed | 2020-03-18 | [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725) |
| 73305c7bd | 2020-03-18 | [AIRFLOW-7081] Remove env variables from GCP guide (#7755) |
| 60fdbf6d9 | 2020-03-18 | [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728) |
| de7e934ca | 2020-03-17 | [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750) |
| 0de0347b2 | 2020-03-17 | [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475) |
| 91557c6f8 | 2020-03-17 | [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738) |
| 51161dbd9 | 2020-03-16 | [AIRFLOW-5664] Store timestamps with microseconds precision (#6354) |
| 2bc020c43 | 2020-03-14 | [AIRFLOW-7055] Verbose logging option for google provider (#7711) |
| c997cab42 | 2020-03-13 | [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630) |
| 137896f32 | 2020-03-12 | [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685) |
| 1f77f943d | 2020-03-10 | [AIRFLOW-6980] Improve system tests and building providers package (#7615) |
| bf9b6b6d7 | 2020-03-09 | [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664) |
| e5130dc9f | 2020-03-09 | [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659) |
| faf0df4b9 | 2020-03-09 | [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666) |
| 42eef3821 | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
| b5b9795f0 | 2020-03-07 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624) |
| 6b65038fb | 2020-03-06 | [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631) |
| 755fe5224 | 2020-03-05 | [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535) |
| cb2f33911 | 2020-03-04 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609) |
| 09fea3ce8 | 2020-03-04 | [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612) |
| 8230ccc48 | 2020-03-04 | [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547) |
| 0d1e3088a | 2020-03-04 | [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604) |
| ab6bb0012 | 2020-03-03 | [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607) |
| 3db4ade3d | 2020-02-29 | [AIRFLOW-6924] Fix Google DLP operators return types (#7546) |
| 008b4bab1 | 2020-02-27 | [AIRFLOW-6730] Use total_seconds instead of seconds (#7363) |
| bb552b2d9 | 2020-02-25 | [AIRFLOW-6908] Lazy load AirflowException (#7528) |
| d1a34246a | 2020-02-25 | [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322) |
| 3320e432a | 2020-02-24 | [AIRFLOW-6817] Lazy-load airflow.DAG to keep user-facing API untouched (#7517) |
| dcf874352 | 2020-02-24 | [AIRFLOW-6894] Prevent db query in example_dags (#7516) |
| 4d03e33c1 | 2020-02-22 | [AIRFLOW-6817] remove imports from airflow/__init__.py, replaced implicit imports with explicit imports, added entry to UPDATING.MD - squashed/rebased (#7456) |
| 35b961637 | 2020-02-21 | [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486) |
| aff3a361b | 2020-02-20 | [AIRFLOW-6558] Campaign Manager operators for conversions (#7420) |
| 9cbd7de6d | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
| 5b199cb86 | 2020-02-17 | [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429) |
| 2c9345a8e | 2020-02-17 | [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400) |
| 946bdc23c | 2020-02-16 | [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126) |
| 2381c820c | 2020-02-13 | [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399) |
| 04c1fefbf | 2020-02-03 | [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307) |
| a0252748f | 2020-02-03 | [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340) |
| 97a429f9d | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
| 9d8d07557 | 2020-02-03 | [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337) |
| cf141506a | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
| 373c6aa4a | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
| 83c037873 | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
| 057f3ae3a | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
| ceea293c1 | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
| c42a375e7 | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
| 059eda05f | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
| f4d3e5e54 | 2020-01-13 | [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151) |
| e7bf8ecb4 | 2020-01-13 | [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125) |
| 5b6772cb8 | 2020-01-09 | [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112) |
| 4f8592ae8 | 2020-01-08 | [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046) |
| 20299473f | 2020-01-03 | [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020) |
| 18e8cea4e | 2020-01-03 | [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007) |
| 95087af14 | 2019-12-31 | [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968) |
| 69629a5a9 | 2019-12-09 | [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464) |
| 25e9047a4 | 2019-12-09 | [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749) |
| ed0a14f32 | 2019-12-09 | [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734) |
| 2f2f89c14 | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
| 03c870a61 | 2019-11-26 | [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601) |
| 5c4cfea8c | 2019-11-15 | [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393) |
| 44a8c37a9 | 2019-11-13 | [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581) |
| d633d3ac4 | 2019-11-13 | [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371) |
| d985c02d9 | 2019-11-05 | [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497) |
| a296cdabd | 2019-11-04 | [AIRFLOW-5743] Move Google PubSub to providers package (#6476) |
| 470b2a779 | 2019-10-30 | [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421) |
| f2caa451f | 2019-10-27 | [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424) |
| 16d7accb2 | 2019-10-22 | [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170) |
| 4e661f535 | 2019-10-22 | [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228) |
| 19e32b4e2 | 2019-10-18 | [AIRFLOW-5656] Rename provider to providers module (#6333) |
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for apache-airflow-backport-providers-google-2021.3.3.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4018a007d3ebd70c62a6ad829c2c1e3330c5a71bea8f9620568def880a3e5856 |
|
| MD5 | 4fe6a19a53fd33cc254e4161b27fb3d4 |
|
| BLAKE2b-256 | cc4cb0f06a3cd464f0a31b98f643ba8f2cd1b605a4e360ba5b3787c37b5d1751 |
Close
Hashes for apache_airflow_backport_providers_google-2021.3.3-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2f6d70baf1fe9d61a5841b63ba9de876f0f21fe242f41af3129ad287f5e043e1 |
|
| MD5 | fae2b84b81c3f8e232171d093de167d2 |
|
| BLAKE2b-256 | f1809f5db11d513f81f7aba0480edb1506a6b9358db2348a2907ab8f4cec9100 |
