Skip to main content

A py4j based hdfs client for python for native hdfs CLI performance.

Project description

pyhdfs-client

https://pypi.python.org/pypi/pyhdfs_client

A py4j based hdfs client for python providing native hdfs CLI performance.


Features

  • Easy to integrate with python applications
  • No extra overhead to start HDFS client on every call
  • Native HDFS client performance

New in 0.1.2

  • Added Support for UNIX

Sample Usage

>>> from pyhdfs_client.pyhdfs_client import HDFSClient
>>> hdfs_client = HDFSClient()
>>> ret, out, err = hdfs_client.run(['-ls', '/'])
>>> print(out)
Found 1 items
drwxr-xr-x   - gp supergroup          0 2021-03-21 01:10 /f1
>>> hdfs_client.stop() # to terminate hdfs client

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

  • 0.1.1 (2021-03-22)

    • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyhdfs_client-0.1.2.tar.gz (12.3 kB view hashes)

Uploaded Source

Built Distribution

pyhdfs_client-0.1.2-py2.py3-none-any.whl (5.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page