A simplified implementation of BERT
Project description
MiniBert
Un modèle dérivé de Bert, simplifié à l'extrême puisque le modèle n'est constitué que d'une couche d'attention.
Dépendances
pip install -r requirements.txt
## Entrainement
python train_semeval
Le script va entrainer un modèle sur le corpus SemEval et enregistrer ses performances dans le dossier runs.
tensorboard --logdir=runs
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
minibert-0.2.2.tar.gz
(6.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file minibert-0.2.2.tar.gz.
File metadata
- Download URL: minibert-0.2.2.tar.gz
- Upload date:
- Size: 6.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
789ffef90e280531a57726ca8cc40f76b584e5f4711ffaa49fa7f8dee82266f8
|
|
| MD5 |
0dae349bf0b89ec888449937970721b9
|
|
| BLAKE2b-256 |
f40c60ab92b9471702e08a7386493d9f190e2d904f20eed76f4a28064090a287
|
File details
Details for the file minibert-0.2.2-py3-none-any.whl.
File metadata
- Download URL: minibert-0.2.2-py3-none-any.whl
- Upload date:
- Size: 8.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c2af08aa489d5369f707c3ceeaa7b8f0a2e0d8f94de2b59ebae3ba84eaab4a32
|
|
| MD5 |
9089503f1df6a7c9969d4353cc8c389e
|
|
| BLAKE2b-256 |
bf354947f4b47bb19293f71420350cc9b5039e4ead4c786ba494777f019e6329
|
