Skip to main content

Native HDFS Python bindings based on hdfs-native Rust package.

Installation

pip install hdfs-native

Example

from hdfs_native import Client
client = Client("hdfs://localhost:9000")

status = client.get_file_info("/file.txt")

CLI

There is a built-in CLI hdfsn that implements most of the behavior of hdfs dfs but with a more bash-like syntax. The easiest way to use the CLI is with UV.

Install CLI with UV

uv tool install hdfs-ntaive

Auto-complete support

The CLI supports auto-complete for HDFS paths using argcomplete. There are two ways to enable this support

To permanently enable support for all Python modules using argcomplete:

uv tool install argcomplete
activate-global-python-argcomplete

To enable support just for hdfsn in your active shell:

uv tool install argcomplete
eval "$(register-python-argcomplete hdfsn)"

Kerberos support

Kerberos (SASL GSSAPI) is supported through a runtime dynamic link to libgssapi_krb5. This must be installed separately, but is likely already installed on your system. If not you can install it by:

Debian-based systems

apt-get install libgssapi-krb5-2

RHEL-based systems

yum install krb5-libs

MacOS

brew install krb5

Running tests

The same requirements apply as the Rust tests, requiring Java, Maven, Hadoop, and Kerberos tools to be on your path. Then you can:

python3 -m venv .venv
source .venv/bin/activate
pip3 install maturin
maturin develop -E devel
pytest

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hdfs_native-0.14.4.tar.gz (262.1 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

hdfs_native-0.14.4-cp314-cp314t-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14tWindows x86-64

hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ x86-64

hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

hdfs_native-0.14.4-cp314-cp314t-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

hdfs_native-0.14.4-cp314-cp314t-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.14tmacOS 10.12+ x86-64

hdfs_native-0.14.4-cp310-abi3-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.10+Windows x86-64

hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ ARM64

hdfs_native-0.14.4-cp310-abi3-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

hdfs_native-0.14.4-cp310-abi3-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file hdfs_native-0.14.4.tar.gz.

File metadata

  • Download URL: hdfs_native-0.14.4.tar.gz
  • Upload date:
  • Size: 262.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4.tar.gz
Algorithm Hash digest
SHA256 f113de362ae621e62a91dd066db57696efdd2fbbc5d9b0ff0b8bc0a3d112b313
MD5 d37ed4c2be46df359c5481777db6f4a4
BLAKE2b-256 d621715e10955b5b55e182b33598257c6ed9190af4944606fc98fdc3b4b6f704

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp314-cp314t-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp314-cp314t-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.14t, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 18e6f74b2f5ea536117431c3f27106896fd375631e664501bfb92ae1d7f14dc8
MD5 05f26db5754af7c0275aa6ded2b6b24a
BLAKE2b-256 27ced83e3480c98f099fb71cf586450ee635e485ad1e093118213b880df85d8f

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a1c26cd02aba74ef428715e30ca85bde9867086ac771a653496adcc7225b1fd9
MD5 605c0e21aa656018d4c1fc86b4bb47ec
BLAKE2b-256 7917b745616bd3f0a208137e50eb6c390a7135e3905fe3f23fe2bb23b21fe955

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5d5cd8b250095d6068d07b13414290ac9c0b1be276722c86a26427a6aee24096
MD5 58f8cb9cb9623c0fe0349ff64092778f
BLAKE2b-256 b9c30cd88d4b3ea6f368a9103256706bd2927e33a003eb5ae0e99775b1570921

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp314-cp314t-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.14t, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 adea6784c55dc3630dd1b25f40172dd57c24cace61ad5902413a7aa8b88e478a
MD5 aed280f0cffdd5e56127564b55d86770
BLAKE2b-256 7159f1138d670acb320923151052a39e3b2009461a5656a86d20f78e15fbea22

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp314-cp314t-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp314-cp314t-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.14t, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp314-cp314t-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 e95b6f793819b099fd27bae76b1094681a20951873b29251626280a346193630
MD5 5effbdcb453e0c11299eda8d15c14a86
BLAKE2b-256 7b35085e148f98ce18886453ab51545e676e320090baa374ec29d19667059f63

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp310-abi3-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp310-abi3-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.10+, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 bbc359de127fa7c958394658882baf5526710345dcc66bbf004d51cd00cabfa9
MD5 528f93363df64ddc50564d39178ac244
BLAKE2b-256 fa3023cd24b81d88b302f5fdd8fa9fb3326a094e8d1cd71fd054654bc58ad1fe

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 05e0ebb92a4849fe44ce88ad1bf2206f78ceb41ee0200d210e0eb5bf10c60952
MD5 5b3ac6ecacabfd4eaa6cd366728d20b1
BLAKE2b-256 acc1888d5eb2a034495bb3f46bd630709f6ae9c4e3bec037aa31456fbe346640

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 feb9cf58a0ea429b3407b9470e3ac5e5de52a7290d92f169f81146158d0f2883
MD5 efefed727c79385a3492696c32fb4993
BLAKE2b-256 2a5aa2bb4fd44f17125656c815138379722c05ca883543053555364384e20e6e

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp310-abi3-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.10+, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c543d75cd62ff0eed9e64637d49c58dc1f30740a8b7945e572627bc19b95c511
MD5 d6289e024872eff9878df62e6ad28beb
BLAKE2b-256 bc8b4daf6c5c1060151b0dc0e9dfe149fc7b17bf370d1c59cd3152a3c9402db6

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.4-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.4-cp310-abi3-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.10+, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.4-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 8e9dbe0ab78c78d2b2c4e7a8206bf89fcefb5977f93449a64a1f088e896d6129
MD5 fbf93095c8d89b2efb6918c21a1f6f56
BLAKE2b-256 84b7a8afce466abac87516b2724b28451449c8e720be9d9efd87b68e89e937e3

See more details on using hashes here.

Release history Release notifications | RSS feed

0.14.5

11 files

This release

0.14.4 This release

11 files

0.14.3

11 files

0.14.2

11 files

0.14.1

5 files

0.14.0

5 files

0.13.5

6 files

0.13.4

6 files

0.13.3

6 files

0.13.2

6 files

0.13.1

6 files

0.13.0

6 files

0.12.4

8 files

0.12.3

5 files

0.12.2

5 files

0.12.1

5 files

0.12.0

5 files

0.11.3

5 files

0.11.2

5 files

0.11.1

5 files

0.11.0

5 files

0.10.4

5 files

0.10.3

5 files

0.10.2

5 files

0.10.1

5 files

0.10.0

5 files

0.9.4

5 files

0.9.3

5 files

0.9.2

5 files

0.9.1

5 files

0.8.0

5 files

0.7.0

5 files

0.6.0

5 files

0.5.0

5 files

0.4.0

5 files

0.3.0

5 files

0.2.1

5 files

0.2.0

5 files

0.1.0

6 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page