hdfs 0.2.8

HdfsCLI: a command line interface for WebHDFS.

HdfsCLI

API and command line interface for HDFS.

Features

• Works with secure and insecure clusters (including Kerberos authentication).

• Comprehensive python bindings for the WebHDFS API.

• Lightweight CLI.

CLI

$ hdfs --info --depth=1
   0 B    3d  D  /user/alice

$ echo 'Hello, world!' | hdfs hello.rst --write

$ hdfs --info --depth=1
  14 B    1m  D  /user/alice
  14 B    1m  F  /user/alice/hello.rst

$ hdfs hello.rst --read
Hello, world!

Other options include support for merging part-files, progress meters. Cf. hdfs --help for more.

API

Sample usage of the python bindings:

from hdfs import KerberosClient

# Instantiate the client
client = KerberosClient('http://namenode:port', root='/user/alice')

# Write a file '/user/alice/hello.md' on HDFS with contents 'Hello, world!'
client.write('hello.md', 'Hello, world!')

# Rename it
client.rename('hello.md', 'hello.rst')

# Download it locally
client.download('hello.rst', 'hello.rst')

# Remove it from HDFS
client.delete('hello.rst')

Documentation

The full documentation can be found here.