Skip to main content

Manage your datasets on the Hugging Face Hub

Project description

Atlas_HFDatasets

A command-line tool to manage your datasets on the Hugging Face Hub - upload, download, list, check and remove datasets with ease.

Prerequisites

  • Python 3.7 or higher

Installation

Install the package via pip:

pip install atlas_hfdatasets

Usage

Before using the tool, initialise your Hugging Face credentials:

atlas_hfdatasets init

Commands

  • Upload a dataset

    atlas_hfdatasets upload /path/to/dataset [-n username/repo_name] [-p True/False]
    

    Options:

    • -n: Repository name (format: username/repo_name). Defaults to dataset folder name
    • -p: Make dataset public (default: False)
  • List your datasets

    atlas_hfdatasets list [-f keyword]
    

    Options:

    • -f: Filter datasets by keyword (case-insensitive)
  • Remove a dataset

    atlas_hfdatasets remove username/repo_name [-f True/False]
    

    Options:

    • -f: Force deletion without confirmation (default: False)
  • Download a dataset

    atlas_hfdatasets download username/repo_name [-o output_directory]
    

    Options:

    • -o: Output directory path (default: current directory)
  • Check dataset statistics

    atlas_hfdatasets check username/repo_name
    

Requirements

  • Python ≥ 3.7
  • huggingface-hub
  • datasets

Licence

This project is licensed under the MIT Licence - see the LICENSE file for details.

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

atlas_hfdatasets-1.3.6.tar.gz (7.2 kB view details)

Uploaded Source

Built Distribution

atlas_hfdatasets-1.3.6-py3-none-any.whl (8.8 kB view details)

Uploaded Python 3

File details

Details for the file atlas_hfdatasets-1.3.6.tar.gz.

File metadata

  • Download URL: atlas_hfdatasets-1.3.6.tar.gz
  • Upload date:
  • Size: 7.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.15

File hashes

Hashes for atlas_hfdatasets-1.3.6.tar.gz
Algorithm Hash digest
SHA256 579ed8877b053b8bd5a14a56a1c78e25b1550333eac9523074aa8ad50dbddc2c
MD5 1ed9c74440e66ae6ff5f38b56d7b1495
BLAKE2b-256 2b1b54903629077a3ee41daec605fbdd30fb7bc0bf60f00bbc5754b8ac7ba488

See more details on using hashes here.

File details

Details for the file atlas_hfdatasets-1.3.6-py3-none-any.whl.

File metadata

File hashes

Hashes for atlas_hfdatasets-1.3.6-py3-none-any.whl
Algorithm Hash digest
SHA256 c66fbc5252fbc67fdd2911d8f1595d41f5857735b1481ccfa1ad06a7f4e00d88
MD5 e5bd7524061015d8c3ae5f0513aec2c8
BLAKE2b-256 bfd9ce77b5249561ae4950390cd63c10e0c4c3142bf4e51869379fa08ea90b96

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page