Transformer Implementations
Transformer Implementations and some examples with them
Implemented:
- Vanilla Transformer
- ViT - Vision Transformers
- DeiT - Data efficient image Transformers
Installation
$ pip install transformer-implementations
Language Translation
from "Attention is All You Need": https://arxiv.org/pdf/1706.03762.pdf
Models trained with Implementation:
Multi-class Image Classification with Vision Transformers (ViT)
from "An Image is Worth 16x16 words: Transformers for image recognition at scale": https://arxiv.org/pdf/2010.11929v1.pdf
Models trained with Implementation:
Multi-class Image Classification with Data-efficient image Transformers (DeiT)
from "Training data-efficient image transformers & distillation through attention": https://arxiv.org/pdf/2012.12877v1.pdf
Models trained with Implementation:
Release files for transformer-implementations 0.0.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| transformer_implementations-0.0.7.tar.gz | 5.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| transformer_implementations-0.0.7-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 19.2 kB
Release files / transformer_implementations-0.0.7.tar.gz
| Download URL | transformer_implementations-0.0.7.tar.gz |
|---|---|
| Size | 5.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
bc5ba1f27acffc933df2a6ff87869c7b0d7cb81712c2f377ec774dd4960b6527
|
|
BLAKE2b-256 checksum How to use checksums |
1015eae44a41a36fc56c4e9968bb14a4477b6c31c6e9d78c24de5ef7e8fefcf3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/51.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.7.8
|
Release files / transformer_implementations-0.0.7-py3-none-any.whl
| Download URL | transformer_implementations-0.0.7-py3-none-any.whl |
|---|---|
| Size | 13.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
5bde6543cdd5e96e10a99df555152465dccdd5b994aaf6ee096f6ad987816abb
|
|
BLAKE2b-256 checksum How to use checksums |
cf7f27e49fb1b519f21ed10453b52c003bb0bc5ac11e67ac702dcf7e6243bc5d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/51.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.7.8
|