Skip to main content

Build Status

PyWebHDFS is a Python wrapper for the Hadoop WebHDFS REST API.

Many of the current Python HDFS clients rely on Hadoop Streaming which requires Java to be installed on the local machine. The other option for interacting with HDFS is to use the WebHDFS REST API. The purpose of this project is to simplify interactions with the WebHDFS API. The PyWebHdfs client will implement the exact functions available in the WebHDFS REST API and behave in a manner consistent with the API.

$ pip install pywebhdfs

The initial release provides for basic WebHDFS file and directory operations including:

  1. Create and Write to a File

  2. Append to a File

  3. Open and Read a File

  4. Make a Directory

  5. Rename a File/Directory

  6. Delete a File/Directory

  7. Status of a File/Directory

  8. Checksum of a File

  9. List a Directory

  10. Get/Set/List/Delete Extended Attributes (Requires Hadoop 2.5.x+)

The documentation for the Hadoop WebHDFS REST API can be found at http://hadoop.apache.org/docs/r1.0.4/webhdfs.html

Pypi package: https://pypi.python.org/pypi/pywebhdfs

Documentation: http://pythonhosted.org/pywebhdfs/

Release files for pywebhdfs 0.4.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pywebhdfs 0.4.1
File Size Uploaded
pywebhdfs-0.4.1.tar.gz 15.9 kB Details

Release files / pywebhdfs-0.4.1.tar.gz

Download URL pywebhdfs-0.4.1.tar.gz
Size 15.9 kB
Tags Source
SHA-256 checksum
How to use checksums
27065da98a85beab089e9d0b3a36dca1aeee0392d71650517e9bbcce6f9e8ee5
BLAKE2b-256 checksum
How to use checksums
f0cecdd55fae929bbab54490a4dba4591e630aed169dda491be3c571e9e233ee
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.4.1 This release

1 release file

0.4.0

1 release file

0.3.2

1 release file

0.3.0

1 release file

0.2.4

1 release file

0.2.3

1 release file

0.2.2

1 release file

0.2.1

1 release file

0.2

1 release file

0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page