Skip to main content

Native HDFS Python bindings based on hdfs-native Rust package.

Installation

pip install hdfs-native

Example

from hdfs_native import Client
client = Client("hdfs://localhost:9000")

status = client.get_file_info("/file.txt")

CLI

There is a built-in CLI hdfsn that implements most of the behavior of hdfs dfs but with a more bash-like syntax. The easiest way to use the CLI is with UV.

Install CLI with UV

uv tool install hdfs-ntaive

Auto-complete support

The CLI supports auto-complete for HDFS paths using argcomplete. There are two ways to enable this support

To permanently enable support for all Python modules using argcomplete:

uv tool install argcomplete
activate-global-python-argcomplete

To enable support just for hdfsn in your active shell:

uv tool install argcomplete
eval "$(register-python-argcomplete hdfsn)"

Kerberos support

Kerberos (SASL GSSAPI) is supported through a runtime dynamic link to libgssapi_krb5. This must be installed separately, but is likely already installed on your system. If not you can install it by:

Debian-based systems

apt-get install libgssapi-krb5-2

RHEL-based systems

yum install krb5-libs

MacOS

brew install krb5

Running tests

The same requirements apply as the Rust tests, requiring Java, Maven, Hadoop, and Kerberos tools to be on your path. Then you can:

python3 -m venv .venv
source .venv/bin/activate
pip3 install maturin
maturin develop -E devel
pytest

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hdfs_native-0.14.2.tar.gz (261.1 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

hdfs_native-0.14.2-cp314-cp314t-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14tWindows x86-64

hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ x86-64

hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

hdfs_native-0.14.2-cp314-cp314t-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

hdfs_native-0.14.2-cp314-cp314t-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.14tmacOS 10.12+ x86-64

hdfs_native-0.14.2-cp310-abi3-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.10+Windows x86-64

hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ ARM64

hdfs_native-0.14.2-cp310-abi3-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

hdfs_native-0.14.2-cp310-abi3-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file hdfs_native-0.14.2.tar.gz.

File metadata

  • Download URL: hdfs_native-0.14.2.tar.gz
  • Upload date:
  • Size: 261.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2.tar.gz
Algorithm Hash digest
SHA256 ec45da13ac9e0275df91e25c09155c61fa4fefc3f9c1cf9a2611c0341731e865
MD5 bc86b2cce1b2ea5e86b3813785262f9b
BLAKE2b-256 6236ef757ef98d12a02d12944671ea24e56e339b74b59e7652afd1c3531fca22

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp314-cp314t-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp314-cp314t-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.14t, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 23923602f4e07b478fb25c6d2072d42a3919eabd2b89d81f38ca6e96ff66b21e
MD5 53238a304b106bc044c6e41d44ff7574
BLAKE2b-256 1526977ee76a5ba5105b272882f122df5a78c14c64f0f98568e63e44aa5b314d

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 969f9cf5608ca0ddb40f79d20beba736cf33475dffedc08aeea2c7a09aed5409
MD5 9bc74daf6d1d82e819f0eccd99b813b8
BLAKE2b-256 b06e9c2bf1eac57f77663aa624c995d73bc11d6659fdde72389275c28ad07cc1

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 e508eec37bf2b94dc6f9307894a069d4e248d7f3e044879b7550be90146444b8
MD5 ccaf93305a229d26de22b0e6f095c06d
BLAKE2b-256 0fbd64bd78f0262877585bd2105c52143c5b1977671995fd4c99d2d3eb97edaf

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp314-cp314t-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.14t, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 bee8a4ae72a2b11f1380b2e667fd8f44165fb8a80a22d265b90cf9ad68dccfcc
MD5 83247debbe92c8e1c96036408aac0908
BLAKE2b-256 29e37b1429de64d35cbe4547cce519ff9b3e652abd0a3413c21d592b429e0556

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp314-cp314t-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp314-cp314t-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.14t, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp314-cp314t-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 8703824cf605b640fc10f90b75aaf9b8ab5e3315ceb728923acaaa81786a2bbf
MD5 6593f9a3d7f67f9b8543a49826133812
BLAKE2b-256 5c6d5708796d1c170b196d6590b17b44dd264816c3d6ac010e6253edde433bcf

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp310-abi3-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp310-abi3-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.10+, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 45f4a376dbd40ec799b577f01a75c440ac5a10b2a77dd1e4c76d0e81462379ee
MD5 1d9d042f484d6713c3acdabc2505bce4
BLAKE2b-256 a54b78fb36fc76bcdd535ee0421e9bbfe32a55f158fc7be59c2b4ec8ed57a0ea

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 f340d45c0f4e1478bde6b7a12f0e5bfca27785fc406be6e61658f8400957b4c5
MD5 f38a630de54781b0eac2d7934eb15975
BLAKE2b-256 326ba279297cf92ab97978dcaf9689d6033478b7f315f99bed4d6c9cff9fbb0f

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 604d8e5853c02d86bc00ffad4d4690bbdc18632fb5b535977cc94a6ae8d76094
MD5 f5601705bcc9749771fd36654b04169d
BLAKE2b-256 8e5b4da13ae4d63d5d1d731cc2111a45c1e61f85190face50352907b1ff71377

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp310-abi3-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.10+, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 0f1257cdc32084463ff8e258d558b6673374c4e71b77324c0a7a5fccadd5e30d
MD5 df50fd66684b8c3b67e6eca7b52ba474
BLAKE2b-256 a54768e20f8caa9ed2a5843354eefc1f4ed4ca6be03f6713e864ce82533c26f6

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.2-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.2-cp310-abi3-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.10+, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.2-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 9c1a789b3ccc12220942ce02c3283a33c80c944c99d165d1d2b80d5331ae3885
MD5 17e611229140cdac3fd924e5264e763d
BLAKE2b-256 80b8f1d5757ecec98a413fd9428e64acf639fa0ba49d39bbfa683516f844510d

See more details on using hashes here.

Release history Release notifications | RSS feed

0.14.5

11 files

0.14.4

11 files

0.14.3

11 files

This release

0.14.2 This release

11 files

0.14.1

5 files

0.14.0

5 files

0.13.5

6 files

0.13.4

6 files

0.13.3

6 files

0.13.2

6 files

0.13.1

6 files

0.13.0

6 files

0.12.4

8 files

0.12.3

5 files

0.12.2

5 files

0.12.1

5 files

0.12.0

5 files

0.11.3

5 files

0.11.2

5 files

0.11.1

5 files

0.11.0

5 files

0.10.4

5 files

0.10.3

5 files

0.10.2

5 files

0.10.1

5 files

0.10.0

5 files

0.9.4

5 files

0.9.3

5 files

0.9.2

5 files

0.9.1

5 files

0.8.0

5 files

0.7.0

5 files

0.6.0

5 files

0.5.0

5 files

0.4.0

5 files

0.3.0

5 files

0.2.1

5 files

0.2.0

5 files

0.1.0

6 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page