HF Transfer
Speed up file transfers with the Hub.
DISCLAIMER
This library is a power user tool, to go beyond ~500MB/s on very high bandwidth
network, where Python cannot cap out the available bandwidth.
This is not meant to be a general usability tool. It purposefully lacks progressbars and comes generally as-is.
Please file issues only if there's an issue on the underlying downloaded file.
Contributing
python3 -m venv ~/.venv/hf_transfer
source ~/.venv/hf_transfer/bin/activate
pip install maturin
maturin develop
huggingface_hub
If you are working on changes with huggingface_hub
git clone git@github.com:huggingface/huggingface_hub.git
# git clone https://github.com/huggingface/huggingface_hub.git
cd huggingface_hub
python3 -m pip install -e ".[quality]"
You can use the following test script:
import os
# os.environ["HF_ENDPOINT"] = "http://localhost:5564"
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
from huggingface_hub import HfApi, logging
logging.set_verbosity_debug()
hf = HfApi()
hf.upload_file(path_or_fileobj="/path/to/my/repo/some_file", path_in_repo="some_file", repo_id="my/repo", repo_type="model")
3 maintainers
Metadata
3 maintainers
Release files for hf-transfer 0.1.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hf_transfer-0.1.9.tar.gz | 25.2 kB | Details |
Built distributions (wheels)
Total release size: 72.0 MB
Release files / hf_transfer-0.1.9.tar.gz
| Download URL | hf_transfer-0.1.9.tar.gz |
|---|---|
| Size | 25.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
035572865dab29d17e783fbf1e84cf1cb24f3fcf8f1b17db1cfc7fdf139f02bf
|
|
BLAKE2b-256 checksum How to use checksums |
1aeb8fc64f40388c29ce8ce3b2b180a089d4d6b25b1d0d232d016704cb852104
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_x86_64.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
a5b366d34cd449fe9b20ef25941e6eef0460a2f74e7389f02e673e1f88ebd538
|
|
BLAKE2b-256 checksum How to use checksums |
45076661e43fbee09594a8a5e9bb778107d95fe38dac4c653982afe03d32bd4d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_i686.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_i686.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-32 |
|
SHA-256 checksum How to use checksums |
5d561f0520f493c66b016d99ceabe69c23289aa90be38dd802d2aef279f15751
|
|
BLAKE2b-256 checksum How to use checksums |
dceb47e477bdf1d784f31c7540db6cc8c354b777e51a186897a7abda34517f36
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_armv7l.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_armv7l.whl |
|---|---|
| Size | 3.4 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARMv7l |
|
SHA-256 checksum How to use checksums |
57fd9880da1ee0f47250f735f791fab788f0aa1ee36afc49f761349869c8b4d9
|
|
BLAKE2b-256 checksum How to use checksums |
d8a30ed697279f5eeb7a40f279bd783cf50e6d0b91f24120dcf66ef2cf8822b4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_aarch64.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-musllinux_1_2_aarch64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARM64 |
|
SHA-256 checksum How to use checksums |
e6ac4eddcd99575ed3735ed911ddf9d1697e2bd13aa3f0ad7e3904dd4863842e
|
|
BLAKE2b-256 checksum How to use checksums |
a9f79ac239b6ee6fe0bad130325d987a93ea58c4118e50479f0786f1733b37e8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 3.5 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
0d991376f0eac70a60f0cbc95602aa708a6f7c8617f28b4945c1431d67b8e3c8
|
|
BLAKE2b-256 checksum How to use checksums |
8c8a79dbce9006e0bd6b74516f97451a7b7c64dbbb426df15d901dd438cfeee3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 3.4 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ PowerPC 64-le |
|
SHA-256 checksum How to use checksums |
2c7fc1b85f4d0f76e452765d7648c9f4bfd0aedb9ced2ae1ebfece2d8cfaf8e2
|
|
BLAKE2b-256 checksum How to use checksums |
50d02b213eb1ea8b1252ccaf1a6c804d0aba03fea38aae4124df6a3acb70511a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 3.6 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-32 |
|
SHA-256 checksum How to use checksums |
504b8427fd785dd8546d53b9fafe6e436bd7a3adf76b9dce556507650a7b4567
|
|
BLAKE2b-256 checksum How to use checksums |
8d0d727abdfba39bc3f1132cfa4c970588c2c0bb0d82fe2d645cc10f4e2f8e0b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 3.1 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ ARMv7l |
|
SHA-256 checksum How to use checksums |
3a736dfbb2c84f5a2c975478ad200c0c8bfcb58a25a35db402678fb87ce17fa4
|
|
BLAKE2b-256 checksum How to use checksums |
15a1f4e27c5ad17aac616ae0849e2aede5aae31db8267a948c6b3eeb9fd96446
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ ARM64 |
|
SHA-256 checksum How to use checksums |
8674026f21ed369aa2a0a4b46000aca850fc44cd2b54af33a172ce5325b4fc82
|
|
BLAKE2b-256 checksum How to use checksums |
fb38130a5ac3747f104033591bcac1c961cb1faadfdc91704f59b09c0b465ff2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-macosx_11_0_arm64.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
3ebc4ab9023414880c8b1d3c38174d1c9989eb5022d37e814fa91a3060123eb0
|
|
BLAKE2b-256 checksum How to use checksums |
ea2e3d60b1a9e9f29a2152aa66c823bf5e399ae7be3fef310ff0de86779c5d2d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp313-cp313t-macosx_10_12_x86_64.whl
| Download URL | hf_transfer-0.1.9-cp313-cp313t-macosx_10_12_x86_64.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.13 CPython 3.13 free-threading macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
6e94e8822da79573c9b6ae4d6b2f847c59a7a06c5327d7db20751b68538dc4f6
|
|
BLAKE2b-256 checksum How to use checksums |
a4780dce00208f585fae675f40033ef9a30dedfa83665d5ac79f16beb4a0a6c2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-win_amd64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-win_amd64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.8 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
16f208fc678911c37e11aa7b586bc66a37d02e636208f18b6bc53d29b5df40ad
|
|
BLAKE2b-256 checksum How to use checksums |
a114f1e15b851d1c2af5b0b1a82bf8eb10bda2da62d98180220ba6fd8879bb5b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-win32.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-win32.whl |
|---|---|
| Size | 1.1 MB |
| Tags | CPython 3.8 Windows x86-32 abi3 |
|
SHA-256 checksum How to use checksums |
435cc3cdc8524ce57b074032b8fd76eed70a4224d2091232fa6a8cef8fd6803e
|
|
BLAKE2b-256 checksum How to use checksums |
0989d4e234727a26b2546c8fb70a276cd924260d60135f2165bf8b9ed67bb9a4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_x86_64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.8 Linux musl 1.2+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
d2fde99d502093ade3ab1b53f80da18480e9902aa960dab7f74fb1b9e5bc5746
|
|
BLAKE2b-256 checksum How to use checksums |
e76ee597b04f753f1b09e6893075d53a82a30c13855cbaa791402695b01e369f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_i686.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_i686.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.8 Linux musl 1.2+ x86-32 abi3 |
|
SHA-256 checksum How to use checksums |
1a6bd16c667ebe89a069ca163060127a794fa3a3525292c900b8c8cc47985b0d
|
|
BLAKE2b-256 checksum How to use checksums |
72854c03da147b6b4b7cb12e074d3d44eee28604a387ed0eaf7eaaead5069c57
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_armv7l.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_armv7l.whl |
|---|---|
| Size | 3.4 MB |
| Tags | CPython 3.8 Linux musl 1.2+ ARMv7l abi3 |
|
SHA-256 checksum How to use checksums |
dc7fff1345980d6c0ebb92c811d24afa4b98b3e07ed070c8e38cc91fd80478c5
|
|
BLAKE2b-256 checksum How to use checksums |
821a9c748befbe3decf7cb415e34f8a0c3789a0a9c55910dea73d581e48c0ce5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_aarch64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-musllinux_1_2_aarch64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.8 Linux musl 1.2+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
89a23f58b7b7effbc047b8ca286f131b17728c99a9f972723323003ffd1bb916
|
|
BLAKE2b-256 checksum How to use checksums |
d6561267c39b65fc8f4e2113b36297320f102718bf5799b544a6cbe22013aa1d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 3.6 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
cdca9bfb89e6f8f281890cc61a8aff2d3cecaff7e1a4d275574d96ca70098557
|
|
BLAKE2b-256 checksum How to use checksums |
d6d8f87ea6f42456254b48915970ed98e993110521e9263472840174d32c880d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 3.4 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ PowerPC 64-le abi3 |
|
SHA-256 checksum How to use checksums |
fc6bd19e1cc177c66bdef15ef8636ad3bde79d5a4f608c158021153b4573509d
|
|
BLAKE2b-256 checksum How to use checksums |
2963b560d39651a56603d64f1a0212d0472a44cbd965db2fa62b99d99cb981bf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 3.6 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-32 abi3 |
|
SHA-256 checksum How to use checksums |
5828057e313de59300dd1abb489444bc452efe3f479d3c55b31a8f680936ba42
|
|
BLAKE2b-256 checksum How to use checksums |
c284aec9ef4c0fab93c1ea2b1badff38c78b4b2f86f0555b26d2051dbc920cde
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 3.1 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ ARMv7l abi3 |
|
SHA-256 checksum How to use checksums |
ee8b10afedcb75f71091bcc197c526a6ebf5c58bbbadb34fdeee6160f55f619f
|
|
BLAKE2b-256 checksum How to use checksums |
f62ea072cf196edfeda3310c9a5ade0a0fdd785e6154b3ce24fc738c818da2a7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
8fd0167c4407a3bc4cdd0307e65ada2294ec04f1813d8a69a5243e379b22e9d8
|
|
BLAKE2b-256 checksum How to use checksums |
8ea2cd7885bc9959421065a6fae0fe67b6c55becdeda4e69b873e52976f9a9f0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-macosx_11_0_arm64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.8 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
8669dbcc7a3e2e8d61d42cd24da9c50d57770bd74b445c65123291ca842a7e7a
|
|
BLAKE2b-256 checksum How to use checksums |
41ba8d9fd9f1083525edfcb389c93738c802f3559cb749324090d7109c8bf4c2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
Release files / hf_transfer-0.1.9-cp38-abi3-macosx_10_12_x86_64.whl
| Download URL | hf_transfer-0.1.9-cp38-abi3-macosx_10_12_x86_64.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.8 abi3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
e66acf91df4a8b72f60223059df3003062a5ae111757187ed1a06750a30e911b
|
|
BLAKE2b-256 checksum How to use checksums |
81f5461d2e5f307e5048289b1168d5c642ae3bb2504e88dff1a38b92ed990a21
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.8.1
|
