Provider for Apache Airflow. Implements apache-airflow-providers-huawei package
Project description
Package apache-airflow-providers-huawei
Release: 1.7.0
Huawei Cloud integration (including Huawei Cloud).
Provider package
This is a provider package for huawei provider. All classes for this provider package are in airflow.providers.huawei python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-huawei
The package supports the following python versions: 3.7,3.8,3.9,3.10
Requirements
PIP package |
Version required |
---|---|
apache-airflow |
>=2.5.0 |
psycopg2 |
>=2.9.4 |
huaweicloudsdkcore |
>=3.1.78 |
esdk-obs-python |
>=3.22.2 |
huaweicloudsdkdws |
>=3.1.21 |
huaweicloudsdksmn |
>=3.1.19 |
huaweicloudsdkdli |
==3.1.67 |
huaweicloudsdkcdm |
>=3.1.78 |
huaweicloudsdkdlf |
>=3.1.19 |
huaweicloudsdkiam |
>=3.1.19 |
huaweicloudsdkmrs |
>=3.1.58 |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-huawei[common.sql]
Dependent package |
Extra |
---|---|
common.sql |
Changelog
1.7.0
Features
Adjust utils directory structure(!63)
Add ModerArts Integration(!61)
1.6.0
Features
Add Huawei Cloud DWS test cases and example dags and document(!57)
Fix return type of get_conn of DWSSqlHook(!56)
Add DWSExecuteQueryOperator and fix DWSSqlHook and DWSClusterSensor(!55)
Add Huawei Cloud DLI example dags and documents(!54)
Add test cases for new features in DLI(!53)
Add new operators, sensors and methods for hooks about DLI(!52)
1.5.1
Features
Add template field "variables" for CDMStartJobOperator(!50)
1.5.0
Features
Fix docs(!47)
Add example code for CDMStartJobOperator and supplementary document(!45)
Add parameter "variables" for CDMStartJobOperator(!44)
1.4.0
Features
Add DLIShowElasticResourcePoolStatusSensor (!42)
Add Huawei Cloud DLI document for new operators (!38)
Add Huawei Cloud DLI example dags (!37)
Add test cases for new features in DLI (!36)
Add new operators, trigger and methods for hooks about DLI (!35)
1.3.0
Features
Add deferred mode for MRSCreateClusterOperator (!33)
Fix stop_job function of MRSHook !(32)
Add and fix document for MRS and DLI (!30)
Add test system sample code for MRS (!29)
Add MRSCreateExecuteJobOperator with deferrable mode and add MRSShowJobResultSensor (!27)
Add test cases for MRS (!28)
1.2.0
Features
Fix docstring (!25)
Add warning according to the DLI product Bulletin (!25)
Add deferrable mode to DLISparkCreateBatchJobOperator and DLIRunSqlJobOperator (!25)
The python sdk version of dli is changed from 3.1.66 to 3.1.67 (!25)
1.1.0
Features
Add Huawei Cloud MRS hook,operators, and sensors (!19)
Add Huawei Cloud MRS test and example dags (!19)
Add "tags" to template_fields for SMNPublishMessageTemplateOperator (!19)
Fix the method docstring for create_cluster method of DWSHook (!19)
Fix example mrs dags (!19)
Add MRS docs and modify other docs (!19)
Add MRS dependencies (!19)
1.0.3
Bug Fixes
Fix the DLISparkCreateBatchJobOperator parameter (!17)
1.0.2
Bug Fixes
Fix the Connections extra param obs-bucket (!15)
1.0.1
Bug Fixes
Fix mistakenly added install_requires for provider (!12)
1.0.0
Initial version of the provider.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for apache-airflow-providers-huawei-1.7.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 484d2d5cd618c2fff1091315f58d3843b2dc39f4e86d327c384674c9d5d85a59 |
|
MD5 | cc904aa52c92e356b3921b37bbe01ab7 |
|
BLAKE2b-256 | d0aa43b515afe0bd7cbb60377a07fa3a89f676fd13fc2d0d7af90cfcb06b48d4 |
Hashes for apache_airflow_providers_huawei-1.7.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 26ce40f46f166c9c31d4a8ae3fff732bec2ac3abd6bb79eca6792f37d85d076b |
|
MD5 | 07b7c8abcc4d3fadf9fbd860a486be1a |
|
BLAKE2b-256 | a9545ecb2860a1dfdde2b0d19094bca74077cb2c702214587d4aa14cb215d0e9 |