A simplified implementation of BERT
Project description
MiniBert
Un modèle dérivé de Bert, simplifié à l'extrême puisque le modèle n'est constitué que d'une couche d'attention.
Dépendances
pip install -r requirements.txt
## Entrainement
python train_semeval
Le script va entrainer un modèle sur le corpus SemEval et enregistrer ses performances dans le dossier runs.
tensorboard --logdir=runs
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
minibert-0.1.0.tar.gz
(4.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file minibert-0.1.0.tar.gz.
File metadata
- Download URL: minibert-0.1.0.tar.gz
- Upload date:
- Size: 4.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6f88769e9e08bc611c7b1c2c33d89e6b2f2c9798e1fbdaf5d08f6d411e45a5a3
|
|
| MD5 |
05f2ea952f438e0e589178a216700b8b
|
|
| BLAKE2b-256 |
f23bd057e0780d0f4f86569a658c5cb122b9b733e0c0457112481a24416723a3
|
File details
Details for the file minibert-0.1.0-py3-none-any.whl.
File metadata
- Download URL: minibert-0.1.0-py3-none-any.whl
- Upload date:
- Size: 6.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d72f05d8ebc1d4f78a22aed5ecaf3aba7a821d130980b4b96424c68b929d1ce7
|
|
| MD5 |
6d05017b5446a3b7dfda3a530253e9cc
|
|
| BLAKE2b-256 |
c485735cb3afabf0cc6735e5a2ebfa9546ca36fe359437feee59a058aa22bb1d
|
