Skip to main content

PyWebHDFS

Build Status

PyWebHDFS is a Python wrapper for the Hadoop WebHDFS REST API.

Many of the current Python HDFS clients rely on Hadoop Streaming which requires Java to be installed on the local machine. The other option for interacting with HDFS is to use the WebHDFS REST API. The purpose of this project is to simplify interactions with the WebHDFS API. The PyWebHdfs client will implement the exact functions available in the WebHDFS REST API and behave in a manner consistent with the API.

$ pip install pywebhdfs

The initial release provides for basic WebHDFS file and directory operations including:

  1. Create and Write to a File

  2. Append to a File

  3. Open and Read a File

  4. Make a Directory

  5. Rename a File/Directory

  6. Delete a File/Directory

  7. Status of a File/Directory

  8. Checksum of a File

  9. List a Directory

  10. Get/Set/List/Delete Extended Attributes (Requires Hadoop 2.5.x+)

The documentation for the Hadoop WebHDFS REST API can be found at http://hadoop.apache.org/docs/r1.0.4/webhdfs.html

Pypi package: https://pypi.python.org/pypi/pywebhdfs

Documentation: http://pythonhosted.org/pywebhdfs/

Metadata

Release files for pywebhdfs 0.4.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pywebhdfs 0.4.1
File Size Uploaded Provenance
pywebhdfs-0.4.1.tar.gz 15.9 kB Without provenance Details

Release files / pywebhdfs-0.4.1.tar.gz

Download URL pywebhdfs-0.4.1.tar.gz
Size 15.9 kB
Tags Source
SHA-256 checksum
How to use checksums
27065da98a85beab089e9d0b3a36dca1aeee0392d71650517e9bbcce6f9e8ee5
BLAKE2b-256 checksum
How to use checksums
f0cecdd55fae929bbab54490a4dba4591e630aed169dda491be3c571e9e233ee
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for pywebhdfs 0.4.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page