No project description provided
Project description
HF Transfer
Speed up file transfers with the Hub.
DISCLAIMER
This library is a power user tool, to go beyond ~500MB/s
on very high bandwidth
network, where Python cannot cap out the available bandwidth.
This is not meant to be a general usability tool. It purposefully lacks progressbars and comes generally as-is.
Please file issues only if there's an issue on the underlying downloaded file.
Contributing
python3 -m venv ~/.venv/hf_transfer
source ~/.venv/hf_transfer/bin/activate
pip install maturin
maturin develop
huggingface_hub
If you are working on changes with huggingface_hub
git clone git@github.com:huggingface/huggingface_hub.git
# git clone https://github.com/huggingface/huggingface_hub.git
cd huggingface_hub
python3 -m pip install -e ".[quality]"
You can use the following test script:
import os
# os.environ["HF_ENDPOINT"] = "http://localhost:5564"
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
from huggingface_hub import HfApi, logging
logging.set_verbosity_debug()
hf = HfApi()
hf.upload_file(path_or_fileobj="/path/to/my/repo/some_file", path_in_repo="some_file", repo_id="my/repo", repo_type="model")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hf_transfer-0.1.4.tar.gz
(20.6 kB
view hashes)
Built Distributions
Close
Hashes for hf_transfer-0.1.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1a466ae2b11d72df9e0005eb8ff7f537d5460c98b64fb6e49f3076ee14040dcf |
|
MD5 | 7d9b78501c0a88a512f12bba65f4c46b |
|
BLAKE2b-256 | 678e590ba84f22aeb4aae784b2037a66fd5232a695f2e3200eadd8ac2c404c8a |
Close
Hashes for hf_transfer-0.1.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 27d0bc1f8b79a6d65751efbce7eb02d2c1bd7e4de1a46aac18995461590ce4dd |
|
MD5 | dbf19d9ab0ff7d2f1395e6e7c43c1402 |
|
BLAKE2b-256 | 1fc2dbef30439447bc19dad3ded4eb92593c8f831aeaf9a1b8f4237b5d8b048b |
Close
Hashes for hf_transfer-0.1.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba0647b84d7ff0eee1de6479179a5d43d0695001733f17eecc00153f0f8ab1ac |
|
MD5 | c286de137090bea06a0361c1bd7420f9 |
|
BLAKE2b-256 | 5487853fb5762b5fc732ca3560a81d04b238f2d5527f4e060d4534e3d5bd4d6e |
Close
Hashes for hf_transfer-0.1.4-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb34a023276936d4716112e17daea4ff98afc35b6113dd0f0383710dc208c058 |
|
MD5 | 56b5dc8533196ce89a78a2e030f2f067 |
|
BLAKE2b-256 | fa56d61442999de77c6e5fc8df7d2b1bc5ee7a0b26512935ad220314099309e9 |
Close
Hashes for hf_transfer-0.1.4-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6b8518b9ebb85b0238745be81f7b88383c7ea216dd8407d46444bcc7806dc0ef |
|
MD5 | 88d1876fe6b33661943bad9b83684e7e |
|
BLAKE2b-256 | 08aa0b71cb22b66c97b646f6261a02c7bfb008c03aa5beb0b658417c0e2bdbc0 |
Close
Hashes for hf_transfer-0.1.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9b9cf169c3c64883b07f7ded5e3f14ae1d437eb77448738b88c923fc5597c47 |
|
MD5 | 6a5c8f544ce15a8e0e661da259a8661f |
|
BLAKE2b-256 | c95201b3d22e20e70d29cd5a021a55506dd211b20f30d581808b453716d9b11d |
Close
Hashes for hf_transfer-0.1.4-cp312-cp312-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d07c0d26b5c01ad50d22ddcff7d30c4e8cbb823565b7f61e0ddb35f7faeae415 |
|
MD5 | f3d777f016f44b751fc821d86dd3dad0 |
|
BLAKE2b-256 | a5a44901c230d555304657840392aff2c7072796546ee842e891efc1a737461a |
Close
Hashes for hf_transfer-0.1.4-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eca1fe6ae145e88455d0a174248080498cea52ad45cee50702070b47dffa421f |
|
MD5 | a331ca8bd446701b9d3ab362df7a5802 |
|
BLAKE2b-256 | 88b0e49957e3abdae8145219b7cba81408a55b6751c4e8a8798ab36e37802781 |
Close
Hashes for hf_transfer-0.1.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63c9c7aef90facf45391c86131ed00e74333637735cfec52da4f5170004d0b3f |
|
MD5 | 1e52740282ceade020daa62ff48ff664 |
|
BLAKE2b-256 | 7bf2d08d8b2f694e13ab5f76189a71fa633b97931536242ad04e3330125f8e99 |
Close
Hashes for hf_transfer-0.1.4-cp311-cp311-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dab1cf4e2e6fcb963fe0e48e6b5e3a95cf65ee376c7b6618a05dbb2ef0dde183 |
|
MD5 | f1c3113551c18ac34619a4112d7a737d |
|
BLAKE2b-256 | 5f9379157cc253e0be42fc6ff1bc9a648679a4e43f7ac2c57b63c7a3f76f3351 |
Close
Hashes for hf_transfer-0.1.4-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84c3ce20c68863a7d998711b98726ba9ae8f2e3fc0d685bc2c9ac9833c0f4048 |
|
MD5 | 236b8a4177bb1036ecf8fe0ec646c56b |
|
BLAKE2b-256 | 6c8a0de4c84e7ef683486ee92e04218dae32262feca9246de9d324307171ad57 |
Close
Hashes for hf_transfer-0.1.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d1c5c20f76e7f3451cff476b85c55dcb8566ebc94a596cb9eb39c0bb75db8675 |
|
MD5 | d07ac579f9307def249e4d040d502da5 |
|
BLAKE2b-256 | 17415fa31aef6167881ff50b3a4bafb9f4320f6a426a5f6d6c2b9f07c475aac0 |
Close
Hashes for hf_transfer-0.1.4-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ff5fbde30a5bed35ef8f0d4ba78bde9f6d60a233dbff78a0e4035d6e6f71e4c |
|
MD5 | 162ebedef55e3f6469d3f2db99a2c329 |
|
BLAKE2b-256 | 157ceea2d2f2877d55ae0e4e9941d18dbeac57a7d8e18528394a05a285c07fc4 |
Close
Hashes for hf_transfer-0.1.4-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc9c7c1d0d79fc06baf86d41620623bb6bb2736755329ea6b1ec5faf71e3e36b |
|
MD5 | da3173f1865ebfcbaddf9ecdeca1fd49 |
|
BLAKE2b-256 | 4dcce788ffbff830d522bae3b56f603c2a1c181e3021b3c8577129550ad2ef8f |
Close
Hashes for hf_transfer-0.1.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f3028a807363e0b2c64985c44732ba4ab187a569f013367d2115a6e09ae95031 |
|
MD5 | 5733519fd7c2d7c11a6d8ccd32583569 |
|
BLAKE2b-256 | c787b40fff957d6a5d0c4aeca0462a76ee210b1749cfb4b5c9dafde9ea56ffe7 |
Close
Hashes for hf_transfer-0.1.4-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c04a93acb58e50b8da1e2258185e54f6bf48ba24bf95e470310178b7047c1017 |
|
MD5 | 601260b4ba21ffc06a5ef1930445362c |
|
BLAKE2b-256 | ca485dceebce23c56431582705542a7f8d2e56cb2a18ab1016dcecf17c91fbe8 |
Close
Hashes for hf_transfer-0.1.4-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ca2d2c40e5e94c5de7e502037ad23ac1d803a2a12760b15b3e3f88c616202bd |
|
MD5 | bbd92b63093f6367b2815576bac4f265 |
|
BLAKE2b-256 | 52d36b712801def8497bcb946e92292b50a8420cd9fbc00ac655c8903b8aae3c |
Close
Hashes for hf_transfer-0.1.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d1977e94e8c8fc8a0e9ce74a651d4694629e526da246a492855fcfb710aa489 |
|
MD5 | 2670c40f741ca077c1aaee64e8a33fee |
|
BLAKE2b-256 | 981144b94296ce08c4e165cd76033434487b341beeff04cfe7918e0fc10c6096 |
Close
Hashes for hf_transfer-0.1.4-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 38bce7a511952e1b804168e956cd3a3b1ff7e38828259c3cdae27614060b90c5 |
|
MD5 | 36c2a8a11c02062fa9991e6a7004dad0 |
|
BLAKE2b-256 | a8fae520d9e454b2e2da2be8a143f96466cf387f339876dbfac78e1778020ca4 |
Close
Hashes for hf_transfer-0.1.4-cp37-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 97555bbff69a0459712e5d25d659c0dc74cb8f9726562ca66241f1e1b081f6a9 |
|
MD5 | cc5c1a2c2095d9b0feeab729db620ed3 |
|
BLAKE2b-256 | c42566c318b49c32226b9510bad62111cf1b4d70b647de37266843bfb8735ef9 |
Close
Hashes for hf_transfer-0.1.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e81a10dbf2ac534083da06c200456b5d10ba7a1e8c4c5c48f7ea1ca4cf6af474 |
|
MD5 | ca6a604799fa9c5d02f492720eac9e21 |
|
BLAKE2b-256 | 70687436e553d03824e18260d8285cc1d0b0e7649be7d7fd6ed99f5022525983 |
Close
Hashes for hf_transfer-0.1.4-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea32e9f91de3f2dad3567577c293f2e81a9309e680def4712ec0c4ea49be6833 |
|
MD5 | 5dbddd5e94e453c9fdbeab81e2f88fc3 |
|
BLAKE2b-256 | c395e77961ab9c31b1cf9477309dde44895bb7ffdd878c3e4573bb3531551a9f |