Skip to main content

Using NAS such as huggingface hub

Project description

Huggingface NAS

Installation

pip3 install huggingface_nas

How to use

Huggingface to Synology NAS (Model)

from huggingface_nas import upload_model

upload_model(
    name="<huggingface model ex. meta-llama/Llama-3.3-70B-Instruct>",
    base_folder="<synology folder>",
    token="<huggingface token>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)

Huggingface to Synology NAS (Dataset)

from huggingface_nas import upload_dataset

upload_dataset(
    name="<huggingface dataset ex. meta-llama/Llama-3.3-70B-Instruct-evals>",
    base_folder="<synology folder>",
    token="<huggingface token>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)

Load dataset from Synology NAS

from huggingface_nas import load_dataset_nas

data = load_dataset_nas(
    path="<model path such as meta-llama/Llama-3.3-70B-Instruct-evals>",
    base_path="<share folder in synology NAS>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)

Load Model from Synology NAS

from transformers import AutoModel
from huggingface_nas import prepare_model_from_nas

model_download_path = prepare_model_from_nas(
    path="<model path such as meta-llama/Llama-3.3-70B-Instruct>",
    base_path="<share folder in synology NAS>",
    ip_address="<synology ip>",
    port="<synology port>",
    username="<synology username>",
    password="<synology password>"
)
AutoModel.from_pretrained(model_download_path)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

huggingface_nas-0.1.0.tar.gz (10.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

huggingface_nas-0.1.0-py3-none-any.whl (10.0 kB view details)

Uploaded Python 3

File details

Details for the file huggingface_nas-0.1.0.tar.gz.

File metadata

  • Download URL: huggingface_nas-0.1.0.tar.gz
  • Upload date:
  • Size: 10.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for huggingface_nas-0.1.0.tar.gz
Algorithm Hash digest
SHA256 67fba42110d7fbd5444955fb0c3d5aedccb2692946d2b1ca3b12bad690fc6c43
MD5 3a385df2437410d2eefdd7485fc84ceb
BLAKE2b-256 e389ae61042fa4a456f9f1ab69824283792b940f9d28a6ad49f6c8a3594b6325

See more details on using hashes here.

Provenance

The following attestation bundles were made for huggingface_nas-0.1.0.tar.gz:

Publisher: publish.yaml on tony9402/huggingface-NAS

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file huggingface_nas-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for huggingface_nas-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6ab61f83ded0ff11f7ea6d906dbcfd9d4c1334b028d3c2427a3585516bb7d6df
MD5 a2e69a40c61df9e2670267ade2b88c8d
BLAKE2b-256 25237074998aa932302cb2611528b17072b61cc97d52278e869c47b871acbde5

See more details on using hashes here.

Provenance

The following attestation bundles were made for huggingface_nas-0.1.0-py3-none-any.whl:

Publisher: publish.yaml on tony9402/huggingface-NAS

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page