Train transformer-based models
Project description
Zelda Rose
A straightforward trainer for transformer-based models.
Installation
Simply install with pipx
pipx install zeldarose
Train MLM models
Here is a short example of training first a tokenizer, then a transformer MLM model:
TOKENIZERS_PARALLELISM=true zeldarose tokenizer --vocab-size 4096 --out-path local/tokenizer --model-name "my-muppet" tests/fixtures/raw.txt
zeldarose
transformer --tokenizer local/tokenizer --pretrained-model flaubert/flaubert_small_cased --out-dir local/muppet --val-text tests/fixtures/raw.txt tests/fixtures/raw.txt
See the documentation for more details!
Citation
If you use Zelda Rose, please cite it as :
Loïc Grobol. 2023. ‘Zelda Rose: A Tool for Hassle-Free Training of Transformer Models’. Paper presented at NLP OSS, Singapore, Indonesia. Proceedings of the 3rd Workshop for Natural Language Processing Open Source Software. https://hal.science/hal-04262806.
Licence
This software is released under the EUPL 1.2 or later, with some files released under compatible free licences, see LICENCE.md for the details.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file zeldarose-0.14.0.tar.gz.
File metadata
- Download URL: zeldarose-0.14.0.tar.gz
- Upload date:
- Size: 1.9 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Manjaro Linux","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2344d65a6960a2f531fc3f18a976c16b19c61da3bf73238407971132bfc4b245
|
|
| MD5 |
0a897b5d7806a7eed7373cc819835d85
|
|
| BLAKE2b-256 |
e57d08b75cfebaec6609a1ce5fbd6bad78a593e3e592ba51985b9945102a9216
|
File details
Details for the file zeldarose-0.14.0-py3-none-any.whl.
File metadata
- Download URL: zeldarose-0.14.0-py3-none-any.whl
- Upload date:
- Size: 40.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Manjaro Linux","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
652da4ebb43b7c290c8db576a973623c83674f75db9bdfb1a6ed1ec173302118
|
|
| MD5 |
967b763090cfeb2480026435428f35a8
|
|
| BLAKE2b-256 |
9e3f52a9f81935eddb8e6d573134a82cb59abf0122c46a2c6aed5afdbedb70f8
|
