Skip to main content

Python wrapper for the Hadoop WebHDFS REST API

Project description

PyWebHDFS

|Build Status|

PyWebHDFS is a Python wrapper for the Hadoop WebHDFS REST API.

Many of the current Python HDFS clients rely on Hadoop Streaming which requires Java to be installed on the local machine. The other option for interacting with HDFS is to use the WebHDFS REST API. The purpose of this project is to simplify interactions with the WebHDFS API. The PyWebHdfs client will implement the exact functions available in the WebHDFS REST API and behave in a manner consistent with the API.

::

$ pip install pywebhdfs

The initial release provides for basic WebHDFS file and directory operations including:

#. Create and Write to a File #. Append to a File #. Open and Read a File #. Make a Directory #. Rename a File/Directory #. Delete a File/Directory #. Status of a File/Directory #. Checksum of a File #. List a Directory #. Get/Set/List/Delete Extended Attributes (Requires Hadoop 2.5.x+)

The documentation for the Hadoop WebHDFS REST API can be found at http://hadoop.apache.org/docs/r1.0.4/webhdfs.html_

Pypi package: https://pypi.python.org/pypi/pywebhdfs_

Documentation: http://pythonhosted.org/pywebhdfs/_

.. _http://hadoop.apache.org/docs/r1.0.4/webhdfs.html: http://hadoop.apache.org/docs/r1.0.4/webhdfs.html .. _https://pypi.python.org/pypi/pywebhdfs: https://pypi.python.org/pypi/pywebhdfs .. _http://pythonhosted.org/pywebhdfs/: http://pythonhosted.org/pywebhdfs/

.. |Build Status| image:: https://travis-ci.org/pywebhdfs/pywebhdfs.svg?branch=master :target: https://travis-ci.org/pywebhdfs/pywebhdfs

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pywebhdfsme-0.0.7.tar.gz (17.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pywebhdfsme-0.0.7-py3-none-any.whl (18.2 kB view details)

Uploaded Python 3

File details

Details for the file pywebhdfsme-0.0.7.tar.gz.

File metadata

  • Download URL: pywebhdfsme-0.0.7.tar.gz
  • Upload date:
  • Size: 17.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.27.0 CPython/3.6.6

File hashes

Hashes for pywebhdfsme-0.0.7.tar.gz
Algorithm Hash digest
SHA256 5358d2594ba17a66f5bf654321ec77b427b1ae4ef5216578fe80f294fd409a24
MD5 c8616b4d8fe64612bcf4b9ca171d8cc9
BLAKE2b-256 e25ebdd033f55dc17b7b12f28fd4b3d6c5d264cc7540f750a8834b6b9afbb302

See more details on using hashes here.

File details

Details for the file pywebhdfsme-0.0.7-py3-none-any.whl.

File metadata

  • Download URL: pywebhdfsme-0.0.7-py3-none-any.whl
  • Upload date:
  • Size: 18.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.27.0 CPython/3.6.6

File hashes

Hashes for pywebhdfsme-0.0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 1ca286ad3ec1ab982c7c93256bc3d46a1f28ac408c05ce58b17f2e39714c1105
MD5 c69661da1dccee506d19608baaa8f4cc
BLAKE2b-256 efe6191cc3ff2b940c102672e53c33b9ff15b9643333c95a85261fa0d07dad5b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page