Skip to main content

Native HDFS Python bindings based on hdfs-native Rust package.

Installation

pip install hdfs-native

Example

from hdfs_native import Client
client = Client("hdfs://localhost:9000")

status = client.get_file_info("/file.txt")

CLI

There is a built-in CLI hdfsn that implements most of the behavior of hdfs dfs but with a more bash-like syntax. The easiest way to use the CLI is with UV.

Install CLI with UV

uv tool install hdfs-ntaive

Auto-complete support

The CLI supports auto-complete for HDFS paths using argcomplete. There are two ways to enable this support

To permanently enable support for all Python modules using argcomplete:

uv tool install argcomplete
activate-global-python-argcomplete

To enable support just for hdfsn in your active shell:

uv tool install argcomplete
eval "$(register-python-argcomplete hdfsn)"

Kerberos support

Kerberos (SASL GSSAPI) is supported through a runtime dynamic link to libgssapi_krb5. This must be installed separately, but is likely already installed on your system. If not you can install it by:

Debian-based systems

apt-get install libgssapi-krb5-2

RHEL-based systems

yum install krb5-libs

MacOS

brew install krb5

Running tests

The same requirements apply as the Rust tests, requiring Java, Maven, Hadoop, and Kerberos tools to be on your path. Then you can:

python3 -m venv .venv
source .venv/bin/activate
pip3 install maturin
maturin develop -E devel
pytest

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hdfs_native-0.14.3.tar.gz (261.2 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

hdfs_native-0.14.3-cp314-cp314t-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14tWindows x86-64

hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ x86-64

hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

hdfs_native-0.14.3-cp314-cp314t-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

hdfs_native-0.14.3-cp314-cp314t-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.14tmacOS 10.12+ x86-64

hdfs_native-0.14.3-cp310-abi3-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.10+Windows x86-64

hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ ARM64

hdfs_native-0.14.3-cp310-abi3-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

hdfs_native-0.14.3-cp310-abi3-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file hdfs_native-0.14.3.tar.gz.

File metadata

  • Download URL: hdfs_native-0.14.3.tar.gz
  • Upload date:
  • Size: 261.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3.tar.gz
Algorithm Hash digest
SHA256 af79bcf33a9f49313a9df6161a1acf1c807cbae53a8d4cdf28df43fa5c3bdd47
MD5 51519a7a80d233626ada7adb9f825389
BLAKE2b-256 96d07c1f5cfb3bdf6bd69e4e61c24d499cf2d0e1e30bdbee10ee1de70876ee5c

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp314-cp314t-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp314-cp314t-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.14t, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 ccf4afcb6beec2d94e51dcc7464d4aeb09f341551819c6ff79481e33f04770b5
MD5 7176aef25cb21ef03d7f38f521d4632a
BLAKE2b-256 0ca83cbf33b7f52f51804b2ac3ce353a334fd13c2b42f4d7b6b7697b7b562184

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b14a76df9b53bcb83ebbfd68267f98e8f12aad90c8597315bc564065337595ca
MD5 e0de644a7fcea665b99de9160ea9abf1
BLAKE2b-256 b9c44ef840bfbb8f44082cf27a40363f31f364a0c56e8f5f1f91637df5dc1bff

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 21159f8a74dc5dbf70d7fbccbeb77c1d41b62aa4919479bf3c9e01ccd1206bbe
MD5 3136431fad0e5a146c128d6b9669c18f
BLAKE2b-256 69b17187a61b9f89e502f9bec32a93bf5e4c3590583f581ee22e7f5da69a4e0a

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp314-cp314t-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.14t, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 5fd0e833d5e1440c05fe4aea0a9674d92db9fc085a1346eab3b8dc8c5967f2ee
MD5 6f312b111587d7045cfe8488b3fc2ee6
BLAKE2b-256 fdc54f0a0ab979e83c76def990c00ef48296a65e8c29ced3af47b0d363e6773c

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp314-cp314t-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp314-cp314t-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.14t, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp314-cp314t-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 1a82809e3f467e848a9fc317b9a584908a453288a80abad7736058096989362a
MD5 6b0144cdaf8da46e14e2994da20c8fc1
BLAKE2b-256 e42b03714357157bc98f13dfa82ab822da936bf10f3f0f11af6b30e7fb57c9e1

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp310-abi3-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp310-abi3-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.10+, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 f9c6cec6b74172c6b7fce9963c262c2aed6bcc557ce4bb3b2cbc7dab21455e60
MD5 cb9ba0b8911d71715e8400debfa15909
BLAKE2b-256 13e7bbd3529e27f28a9aee01ef8a192b21a520befa24ff2812faee9ccbf6bb52

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d42ebcc0de56c2a7f26caf805b4368e132660bb519847493b0c572e6f1590351
MD5 432c40900be7a024dbbbc42a48c3d068
BLAKE2b-256 685b460ed9d4c99b3d4a1969a7cbb723667836725f20a3dc15c0c0bf9258a63e

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 fe21ad3be69a4f0a85520b46b0e4e913a6c997d575d40615a978f20b51535cd7
MD5 193cae159a6c7aed014e8e29bf05a7d7
BLAKE2b-256 04157a3570d1d59f5c3c91d5b6d40829344492daf6964b76c77afc2933cc99c3

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp310-abi3-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.10+, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 18bfa927c79fc9bf120c503a1c7d6e8353ff6a366216a01c502fa09ed703b7d6
MD5 070d3afcee8a2399c475b9a2edb42a5b
BLAKE2b-256 c414e2e96b2eb065f37ade067390daa4b1b2858c5eb58f3fe9ec493497c44da4

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.3-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.3-cp310-abi3-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.10+, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.3-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 b1b51d03abc5228ef7c4a780e033e42a6ebf965ba3f64c7c70de577bfb67ba7f
MD5 eba23a0f5cde4533da05a0b467ae5cff
BLAKE2b-256 e1e0b519b61b86ba6f1c1e9e1f4788eec2350476fa90a8039d041683b1f03f96

See more details on using hashes here.

Release history Release notifications | RSS feed

0.14.5

11 files

0.14.4

11 files

This release

0.14.3 This release

11 files

0.14.2

11 files

0.14.1

5 files

0.14.0

5 files

0.13.5

6 files

0.13.4

6 files

0.13.3

6 files

0.13.2

6 files

0.13.1

6 files

0.13.0

6 files

0.12.4

8 files

0.12.3

5 files

0.12.2

5 files

0.12.1

5 files

0.12.0

5 files

0.11.3

5 files

0.11.2

5 files

0.11.1

5 files

0.11.0

5 files

0.10.4

5 files

0.10.3

5 files

0.10.2

5 files

0.10.1

5 files

0.10.0

5 files

0.9.4

5 files

0.9.3

5 files

0.9.2

5 files

0.9.1

5 files

0.8.0

5 files

0.7.0

5 files

0.6.0

5 files

0.5.0

5 files

0.4.0

5 files

0.3.0

5 files

0.2.1

5 files

0.2.0

5 files

0.1.0

6 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page