HdfsCLI: a command line interface for WebHDFS.
Project description
HdfsCLI
API and command line interface for HDFS.
Features
Works with secure and insecure clusters (including Kerberos authentication).
Comprehensive python bindings for the WebHDFS API.
Lightweight CLI.
CLI
$ hdfs --info --depth=1
0 B 3d D /user/alice
$ echo 'Hello, world!' | hdfs hello.rst --write
$ hdfs --info --depth=1
14 B 1m D /user/alice
14 B 1m F /user/alice/hello.rst
$ hdfs hello.rst --read
Hello, world!
Other options include support for merging part-files, progress meters. Cf.
hdfs --help
for more.
API
Sample usage of the python bindings:
from hdfs import KerberosClient
# Instantiate the client
client = KerberosClient('http://namenode:port', root='/user/alice')
# Write a file '/user/alice/hello.md' on HDFS with contents 'Hello, world!'
client.write('hello.md', 'Hello, world!')
# Rename it
client.rename('hello.md', 'hello.rst')
# Download it locally
client.download('hello.rst', 'hello.rst')
# Remove it from HDFS
client.delete('hello.rst')
Documentation
The full documentation can be found here.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hdfs-0.2.7.tar.gz
(24.2 kB
view hashes)