Skip to main content

A tool that can download Hugging Face model(s)

Project description

NiuDownload

This is a tool that can automatically download models from Hugging Face(Windows or Linux).You can download single model or make batch download. The project is powered by NEU(China) NLPLAB master students: Peinan Feng, Junhao Ruan and Peizhuo Liu. Any issue is welcomed. Only pytorch version models are supported now

Use in python script

Single Download

from sao_download import download as sd
sd.batch_download_models('models', 'gpt2')

In this way, the whole gpt2 model in pytorch version will be stored in "models" directory.

Batch Download

from sao_download import download as sd
sd.batch_download_models('models', ['roberta-base', 'gpt2', 'bert-base-uncased'])
#or 
sd.batch_download_models('models', 'roberta-base, gpt2, bert-base-uncased')

In this way, roberta-base、 gpt2、 bert-base-uncased will be stored in "models" directory.

Use in command line

 niudownload -m bert-base-uncased,gpt2 -d /mnt/lpz/download/

"-m" means the model(s) from Huggingface you want to download "-d" means the output dirct you want to store the model(s)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

niu_download-1.1.0.tar.gz (4.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

niu_download-1.1.0-py3-none-any.whl (4.4 kB view details)

Uploaded Python 3

File details

Details for the file niu_download-1.1.0.tar.gz.

File metadata

  • Download URL: niu_download-1.1.0.tar.gz
  • Upload date:
  • Size: 4.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for niu_download-1.1.0.tar.gz
Algorithm Hash digest
SHA256 06d9f570c834b839895ca5f5e8e300ecc515ec67ca88052ada33a7d2e7c0ca57
MD5 dd1902480e21929a9576e91b3280b3f1
BLAKE2b-256 2b18b07c73ae6d4066072e65426a25de2c3c4f92c956653926ff1ddb06b3c2f9

See more details on using hashes here.

File details

Details for the file niu_download-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: niu_download-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 4.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for niu_download-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ac379d92f48087aa3bca56adbcc1927400fb2190bd23b59fe3fa0d3169e063a1
MD5 0a31726526644794fcdd715aa8d87a70
BLAKE2b-256 4292116ef3a5f4e7f3ccfe4c519f452df83425941986a2c1c8f4a4ee8eb03326

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page