Provider for Apache Airflow. Implements apache-airflow-providers-apache-hdfs package
Project description
Package apache-airflow-providers-apache-hdfs
Release: 3.1.0rc2
Hadoop Distributed File System (HDFS) and WebHDFS.
Provider package
This is a provider package for apache.hdfs provider. All classes for this provider package are in airflow.providers.apache.hdfs python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-hdfs
The package supports the following python versions: 3.7,3.8,3.9,3.10
Requirements
PIP package |
Version required |
|---|---|
apache-airflow |
>=2.2.0 |
snakebite-py3 |
|
hdfs[avro,dataframe,kerberos] |
>=2.0.4 |
Changelog
3.1.0
Features
Adding Authentication to webhdfs sensor (#25110)
3.0.1
Bug Fixes
'WebHDFSHook' Bugfix/optional port (#24550)
3.0.0
Breaking changes
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
Misc
chore: Refactoring and Cleaning Apache Providers (#24219)
2.2.3
Bug Fixes
Fix mistakenly added install_requires for all providers (#22382)
2.2.2
Misc
Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)
2.2.1
Misc
Support for Python 3.10
Add how-to guide for WebHDFS operators (#21393)
2.2.0
Features
hdfs provider: restore HA support for webhdfs (#19711)
2.1.1
Bug Fixes
fix get_connections deprecation warning in webhdfs hook (#18331)
2.1.0
Features
hdfs provider: allow SSL webhdfs connections (#17637)
Misc
Optimise connection importing for Airflow 2.2.0
2.0.0
Breaking changes
Auto-apply apply_default decorator (#15667)
1.0.1
Updated documentation and readme files.
1.0.0
Initial version of the provider.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file apache-airflow-providers-apache-hdfs-3.1.0rc2.tar.gz.
File metadata
- Download URL: apache-airflow-providers-apache-hdfs-3.1.0rc2.tar.gz
- Upload date:
- Size: 16.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e0c4380c407e7dc820be60fc2dda841559bf2bb24e7e34d24433cb8d5d768356
|
|
| MD5 |
59c2902a6813e215d1295d26fdb54dcf
|
|
| BLAKE2b-256 |
4dbe3e6da2d87beb810513cec0c29d08fa21f61e09f4812d3651e1d5c8f828a8
|
File details
Details for the file apache_airflow_providers_apache_hdfs-3.1.0rc2-py3-none-any.whl.
File metadata
- Download URL: apache_airflow_providers_apache_hdfs-3.1.0rc2-py3-none-any.whl
- Upload date:
- Size: 20.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
03ce9e98f48bbef33bf23ff5664e300820efc0ff057991f3bd614dfbb5c19811
|
|
| MD5 |
b9854e2e3e183b30c884d72941042b48
|
|
| BLAKE2b-256 |
08bc96f0a0b862735f876b73e659efe1f8230bac00107479fee395b23697ce8b
|
