Toolkit for managing huggingface models and datasets
Project description
huggingface_tool
Tools for loading, upload, managing huggingface models and datasets
Installation
pip install huggingface-tool
Usage
- Download and save transformer models with:
htool save-model <model_class> <model_name> <save_dir>
- For example:
htool save-model AutoModelForCausalLM gpt2 ./gpt2
- For example:
- Download and save tokenizer with:
htool save-tk <tokenizer_name> <save_dir>
- For example:
htool save-tk gpt2 ./gpt2
- For example:
- Download and save dataset with:
htool save-data <dataset_name> <save_dir>
- For example:
htool save-data daily_dialog ./daily_dialog
- For example:
- Download and save diffusion models with:
htool save-dm <model_name> <save_dir>
- For example:
htool save-dm google/ddpm-cat-256 ./google/
- For example:
Citing huggingface_tool
If our work has been helpful to you, please feel free to cite us:
@misc{huggingface_tool2023,
title={huggingface_tool},
author={OpenRL Contributors},
publisher = {GitHub},
howpublished = {\url{https://github.com/OpenRL-Lab/huggingface_tool}},
year={2023},
}
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
huggingface_tool-0.0.2.tar.gz
(10.6 kB
view hashes)
Built Distribution
Close
Hashes for huggingface_tool-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 082f031438766632b41088a947cbef46386e64a0830e20178b40ba886ee882d0 |
|
MD5 | 9048cc38be76df91b5159540d800b45d |
|
BLAKE2b-256 | dd94d753718fe33011c027ad3bab50214b34966eef80c1054fdfb414ab6121a7 |