Skip to main content

Using NAS such as huggingface hub

Project description

Huggingface NAS

Installation

pip3 install huggingface_nas

How to use

Huggingface to Synology NAS (Model)

from huggingface_nas import upload_model

upload_model(
    name="<huggingface model ex. meta-llama/Llama-3.3-70B-Instruct>",
    base_folder="<synology folder>",
    token="<huggingface token>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)

Huggingface to Synology NAS (Dataset)

from huggingface_nas import upload_dataset

upload_dataset(
    name="<huggingface dataset ex. meta-llama/Llama-3.3-70B-Instruct-evals>",
    base_folder="<synology folder>",
    token="<huggingface token>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)

Load dataset from Synology NAS

from huggingface_nas import load_dataset_nas

data = load_dataset_nas(
    path="<model path such as meta-llama/Llama-3.3-70B-Instruct-evals>",
    base_path="<share folder in synology NAS>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)

Load Model from Synology NAS

from transformers import AutoModel
from huggingface_nas import prepare_model_from_nas

model_download_path = prepare_model_from_nas(
    path="<model path such as meta-llama/Llama-3.3-70B-Instruct>",
    base_path="<share folder in synology NAS>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)
AutoModel.from_pretrained(model_download_path)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

huggingface_nas-0.1.0.post2.tar.gz (10.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

huggingface_nas-0.1.0.post2-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file huggingface_nas-0.1.0.post2.tar.gz.

File metadata

  • Download URL: huggingface_nas-0.1.0.post2.tar.gz
  • Upload date:
  • Size: 10.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for huggingface_nas-0.1.0.post2.tar.gz
Algorithm Hash digest
SHA256 e43b20cbc8f78149d6b3fedcb65fad9a5fb41244c2392b91d29438e02cad1f43
MD5 046211f8cbb2ac388cc5205291ef2cd3
BLAKE2b-256 02fdad13f06999d1a4d5f9770157ca8024ea4ed857895a9eb1b1c2e527b9b774

See more details on using hashes here.

Provenance

The following attestation bundles were made for huggingface_nas-0.1.0.post2.tar.gz:

Publisher: publish.yaml on tony9402/huggingface-NAS

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file huggingface_nas-0.1.0.post2-py3-none-any.whl.

File metadata

File hashes

Hashes for huggingface_nas-0.1.0.post2-py3-none-any.whl
Algorithm Hash digest
SHA256 4bdb0dda10d98097bf325334919ec88f3628416b7fdc3da149d672549543a9a5
MD5 787637a839d87907ea1210ab92f89a84
BLAKE2b-256 02797fec91c9ec9d727bbe73cb2c0f10ebef97a120f6a4ba0519ab40c0639363

See more details on using hashes here.

Provenance

The following attestation bundles were made for huggingface_nas-0.1.0.post2-py3-none-any.whl:

Publisher: publish.yaml on tony9402/huggingface-NAS

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page