Skip to main content

Python wrapper for the Hadoop WebHDFS REST API

Project description

Version 0.2.4 - Support HDFS paths with unicode characters, thanks to contribution from Leonardo Trabuco(ltrabuco)

PyWebHDFS is a Python wrapper for the Hadoop WebHDFS REST API.

Many of the current Python HDFS clients rely on Hadoop Streaming which requires Java to be installed on the local machine. The other option for interacting with HDFS is to use the WebHDFS REST API. The purpose of this project is to simplify interactions with the WebHDFS API. The PyWebHdfs client will implement the exact functions available in the WebHDFS REST API and behave in a manner consistent with the API.

The initial release provides for basic WebHDFS file and directory operations including:

  1. Create and Write to a File

  2. Append to a File

  3. Open and Read a File

  4. Make a Directory

  5. Rename a File/Directory

  6. Delete a File/Directory

  7. Status of a File/Directory

  8. List a Directory

The documentation for the Hadoop WebHDFS REST API can be found at [http://hadoop.apache.org/docs/r1.0.4/webhdfs.html](http://hadoop.apache.org/docs/r1.0.4/webhdfs.html)

Pypi package: [https://pypi.python.org/pypi/pywebhdfs](https://pypi.python.org/pypi/pywebhdfs) Documentation: [http://pythonhosted.org/pywebhdfs/](http://pythonhosted.org/pywebhdfs/)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pywebhdfs-0.2.4.tar.gz (4.1 kB view details)

Uploaded Source

File details

Details for the file pywebhdfs-0.2.4.tar.gz.

File metadata

  • Download URL: pywebhdfs-0.2.4.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for pywebhdfs-0.2.4.tar.gz
Algorithm Hash digest
SHA256 f6481b0f881816a1ecd75a98fa2e091a91e24e8cf9600286599b92d7b368d281
MD5 5490ae975703923128bedf9e93351496
BLAKE2b-256 e00afaff22ccc25762389f80e86b130921c22552821051e08acb03aeab39bab9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page