Skip to main content

Native HDFS Python bindings based on hdfs-native Rust package.

Installation

pip install hdfs-native

Example

from hdfs_native import Client
client = Client("hdfs://localhost:9000")

status = client.get_file_info("/file.txt")

To use explicit Kerberos credentials, pass the principal and optionally a keytab and/or credential cache to either Client or AsyncClient:

from hdfs_native import Client

client = Client(
    "hdfs://namenode.example.com:9000",
    kerberos_principal="client@EXAMPLE.COM",
    kerberos_keytab="/run/secrets/client.keytab",
)

kerberos_principal is required when kerberos_keytab or kerberos_cache is provided. A keytab without an explicit cache uses a native in-memory cache. The same arguments are available on AsyncClient.

CLI

There is a built-in CLI hdfsn that implements most of the behavior of hdfs dfs but with a more bash-like syntax. The easiest way to use the CLI is with UV.

Install CLI with UV

uv tool install hdfs-ntaive

Auto-complete support

The CLI supports auto-complete for HDFS paths using argcomplete. There are two ways to enable this support

To permanently enable support for all Python modules using argcomplete:

uv tool install argcomplete
activate-global-python-argcomplete

To enable support just for hdfsn in your active shell:

uv tool install argcomplete
eval "$(register-python-argcomplete hdfsn)"

Kerberos support

Kerberos (SASL GSSAPI) is supported through a runtime dynamic link to libgssapi_krb5. This must be installed separately, but is likely already installed on your system. If not you can install it by:

Debian-based systems

apt-get install libgssapi-krb5-2

RHEL-based systems

yum install krb5-libs

MacOS

brew install krb5

Running tests

The same requirements apply as the Rust tests, requiring Java, Maven, Hadoop, and Kerberos tools to be on your path. Then you can:

python3 -m venv .venv
source .venv/bin/activate
pip3 install maturin
maturin develop -E devel
pytest

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hdfs_native-0.14.5.tar.gz (275.4 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

hdfs_native-0.14.5-cp314-cp314t-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14tWindows x86-64

hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.8 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ x86-64

hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

hdfs_native-0.14.5-cp314-cp314t-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

hdfs_native-0.14.5-cp314-cp314t-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.14tmacOS 10.12+ x86-64

hdfs_native-0.14.5-cp310-abi3-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.10+Windows x86-64

hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.8 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ ARM64

hdfs_native-0.14.5-cp310-abi3-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

hdfs_native-0.14.5-cp310-abi3-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file hdfs_native-0.14.5.tar.gz.

File metadata

  • Download URL: hdfs_native-0.14.5.tar.gz
  • Upload date:
  • Size: 275.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5.tar.gz
Algorithm Hash digest
SHA256 06c03a5dc9c410afc6b8c613265a16b2a1484267a2ec30f1e38489b730ad0ed8
MD5 d568cd5c2d022bba89baa14d9d560a08
BLAKE2b-256 ac5303ca11e51afae43d4b2c15774a66453be374aa79f0a98a4c95289d336274

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp314-cp314t-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp314-cp314t-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.14t, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 4dd5ba0b11699b9da8823f544e9159bd62f76b96eed94306e53afc572c7f2589
MD5 fdd17468cfa16813e84ddfacf6e2bb92
BLAKE2b-256 a3a00108d651aa3692ec9c62ffa0996654d55fbaedd64a6ab01580e507fc852c

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.8 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 1d8b82a711b4591416a83dbfdffe6634b9523e5950a17b9833c2dc447f5157e5
MD5 e9bcefe7309d170643321347338c9e13
BLAKE2b-256 54fdd9822ad6d6b343055d1efcf899713fa9ba02949d110f9147885602156447

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.14t, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 cbc5298a0f56831528674b737e5098625925dd7f3b4cc950438d3ec62fc56078
MD5 bf7dfe70482c557ae77726b030f97d0b
BLAKE2b-256 39645d38f0fa97e1641d0b3ee18d3ba01c1b014525d7a026966d25b5ebcdd62b

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp314-cp314t-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.14t, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 d3f86a921833a150fbf6be02807333b630244ad298907056d739ad8d3365f316
MD5 a556a6a0aad46a86b1b4b9cdaddf507c
BLAKE2b-256 48a4f245f2be1411b2b1b9716579a043aacd3ef7ff462a559f2fe42fe7e5543a

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp314-cp314t-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp314-cp314t-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.14t, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp314-cp314t-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 dd4beb851528ed6d40d87ded8c66c1747f7ef6b70671e90ba422c755d5bea9a5
MD5 30e3f21a78a2812d6b4c335181d585ab
BLAKE2b-256 0aef58a06d687231f1159d6743fa5c286359f7ba2ba38ec82b3ead16d7d020ff

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp310-abi3-win_amd64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp310-abi3-win_amd64.whl
  • Upload date:
  • Size: 5.0 MB
  • Tags: CPython 3.10+, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 e15e2d61974f9f1b3f17eccf1545f144fdf8bc04ce4f34f56cfa215cc9785f17
MD5 b3bfc48633bd972d774df677689d195f
BLAKE2b-256 60f6291a13cef883067d727627f2ba44bfab196ce8a86d8beb7e58cf9c33ec0a

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
  • Upload date:
  • Size: 5.8 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9ae593d6efb6dbd1942c77349aca4b586b90044e347c8df6ba46604708eee8e2
MD5 115007b813a12862df13d12bc1e0c044
BLAKE2b-256 6b0c1da79f9f83df3af4fcd0e15860c4be42c48b4167a8950727330b9a5b245e

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
  • Upload date:
  • Size: 5.7 MB
  • Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 3fdfe96c7ec9047242b282d896c0e43c5ffbc19493c34a7bae4c692341d9753b
MD5 568aa2d67e0e297aaf3f02669d4fd75c
BLAKE2b-256 32e603c4c938e85744759e476f455b5639873369e3261593dabc942733de8471

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp310-abi3-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 5.2 MB
  • Tags: CPython 3.10+, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 52f1452fb4295dc52cc7fc0bdf9ff221106bb57177a4c50e054bd60e479f3522
MD5 885189885c05bc8d0cca728845ccff99
BLAKE2b-256 bc98b3b20a1a2d5fd0ddc3a0c6bba980d7c15c446e745258fb20a3f941ecc641

See more details on using hashes here.

File details

Details for the file hdfs_native-0.14.5-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: hdfs_native-0.14.5-cp310-abi3-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 5.5 MB
  • Tags: CPython 3.10+, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.6 {"installer":{"name":"uv","version":"0.12.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hdfs_native-0.14.5-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 7b35011460d46866c1943d369511c3eee7f793a5c0d062fbc28788085779b406
MD5 a0d81f0a48fd6a1d0f4b5f192af05968
BLAKE2b-256 f2840aa88e56af64d2b719f8c64c5e227773d4b5e78843b9a62095850c631520

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.14.5 This release

11 files

0.14.4

11 files

0.14.3

11 files

0.14.2

11 files

0.14.1

5 files

0.14.0

5 files

0.13.5

6 files

0.13.4

6 files

0.13.3

6 files

0.13.2

6 files

0.13.1

6 files

0.13.0

6 files

0.12.4

8 files

0.12.3

5 files

0.12.2

5 files

0.12.1

5 files

0.12.0

5 files

0.11.3

5 files

0.11.2

5 files

0.11.1

5 files

0.11.0

5 files

0.10.4

5 files

0.10.3

5 files

0.10.2

5 files

0.10.1

5 files

0.10.0

5 files

0.9.4

5 files

0.9.3

5 files

0.9.2

5 files

0.9.1

5 files

0.8.0

5 files

0.7.0

5 files

0.6.0

5 files

0.5.0

5 files

0.4.0

5 files

0.3.0

5 files

0.2.1

5 files

0.2.0

5 files

0.1.0

6 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page