Zelda Rose
A straightforward trainer for transformer-based models.
Installation
Simply install with pipx
pipx install zeldarose
Train MLM models
Here is a short example of training first a tokenizer, then a transformer MLM model:
TOKENIZERS_PARALLELISM=true zeldarose tokenizer --vocab-size 4096 --out-path local/tokenizer --model-name "my-muppet" tests/fixtures/raw.txt
zeldarose
transformer --tokenizer local/tokenizer --pretrained-model flaubert/flaubert_small_cased --out-dir local/muppet --val-text tests/fixtures/raw.txt tests/fixtures/raw.txt
See the documentation for more details!
Citation
If you use Zelda Rose, please cite it as :
Loïc Grobol. 2023. ‘Zelda Rose: A Tool for Hassle-Free Training of Transformer Models’. Paper presented at NLP OSS, Singapore, Indonesia. Proceedings of the 3rd Workshop for Natural Language Processing Open Source Software. https://hal.science/hal-04262806.
Licence
This software is released under the EUPL 1.2 or later, with some files released under compatible free licences, see LICENCE.md for the details.
1 maintainer
Metadata
1 maintainer
Release files for zeldarose 0.14.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| zeldarose-0.14.0.tar.gz | 1.9 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| zeldarose-0.14.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 2.0 MB
Release files / zeldarose-0.14.0.tar.gz
| Download URL | zeldarose-0.14.0.tar.gz |
|---|---|
| Size | 1.9 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2344d65a6960a2f531fc3f18a976c16b19c61da3bf73238407971132bfc4b245
|
|
BLAKE2b-256 checksum How to use checksums |
e57d08b75cfebaec6609a1ce5fbd6bad78a593e3e592ba51985b9945102a9216
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Manjaro Linux","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / zeldarose-0.14.0-py3-none-any.whl
| Download URL | zeldarose-0.14.0-py3-none-any.whl |
|---|---|
| Size | 40.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
652da4ebb43b7c290c8db576a973623c83674f75db9bdfb1a6ed1ec173302118
|
|
BLAKE2b-256 checksum How to use checksums |
9e3f52a9f81935eddb8e6d573134a82cb59abf0122c46a2c6aed5afdbedb70f8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Manjaro Linux","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
