Skip to main content

Manage your datasets on the Hugging Face Hub

Project description

Atlas_HFDatasets

A command-line tool to manage your datasets on the Hugging Face Hub - upload, download, list, check and remove datasets with ease.

Prerequisites

  • Python 3.7 or higher

Installation

Install the package via pip:

pip install atlas_hfdatasets

Usage

Before using the tool, initialise your Hugging Face credentials:

atlas_hfdatasets init

Commands

  • Upload a dataset

    atlas_hfdatasets upload /path/to/dataset [-n username/repo_name] [-p True/False]
    

    Options:

    • -n: Repository name (format: username/repo_name). Defaults to dataset folder name
    • -p: Make dataset public (default: False)
  • List your datasets

    atlas_hfdatasets list [-f keyword]
    

    Options:

    • -f: Filter datasets by keyword (case-insensitive)
  • Remove a dataset

    atlas_hfdatasets remove username/repo_name [-f True/False]
    

    Options:

    • -f: Force deletion without confirmation (default: False)
  • Download a dataset

    atlas_hfdatasets download username/repo_name [-o output_directory]
    

    Options:

    • -o: Output directory path (default: current directory)
  • Check dataset statistics

    atlas_hfdatasets check username/repo_name
    

Requirements

  • Python ≥ 3.7
  • huggingface-hub
  • datasets

Licence

This project is licensed under the MIT Licence - see the LICENSE file for details.

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

atlas_hfdatasets-1.3.5.tar.gz (7.8 kB view details)

Uploaded Source

Built Distribution

atlas_hfdatasets-1.3.5-py3-none-any.whl (8.9 kB view details)

Uploaded Python 3

File details

Details for the file atlas_hfdatasets-1.3.5.tar.gz.

File metadata

  • Download URL: atlas_hfdatasets-1.3.5.tar.gz
  • Upload date:
  • Size: 7.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.15

File hashes

Hashes for atlas_hfdatasets-1.3.5.tar.gz
Algorithm Hash digest
SHA256 768360335253930ff0696efa997e8115d591019440fe0f44d24c5ba8f7809313
MD5 e3c11e797edd1d8b5e90e7e0f192d022
BLAKE2b-256 1cc2396badb752e7b139cc3303248e26dadeed033b9caf4811ec793376157d01

See more details on using hashes here.

File details

Details for the file atlas_hfdatasets-1.3.5-py3-none-any.whl.

File metadata

File hashes

Hashes for atlas_hfdatasets-1.3.5-py3-none-any.whl
Algorithm Hash digest
SHA256 cfa136bfc3cd89656bda5a6fe457b3002a07262ca55e6ed02ec961aabad7f87b
MD5 268ec4e450bb61c09ceb2cf67dc3caa2
BLAKE2b-256 b5443a683d3333995de1a4c361bb42c41088f92cd12eeabe85af2f9a0bf82762

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page