Skip to main content

Transformer Implementations

Transformer Implementations and some examples with them

Implemented:

  • Vanilla Transformer
  • ViT - Vision Transformers
  • DeiT - Data efficient image Transformers

Installation

PyPi Installation

$ pip install transformer-implementations

Language Translation

from "Attention is All You Need": https://arxiv.org/pdf/1706.03762.pdf

Models trained with Implementation:

Multi-class Image Classification with Vision Transformers (ViT)

from "An Image is Worth 16x16 words: Transformers for image recognition at scale": https://arxiv.org/pdf/2010.11929v1.pdf

Models trained with Implementation:

Multi-class Image Classification with Data-efficient image Transformers (DeiT)

from "Training data-efficient image transformers & distillation through attention": https://arxiv.org/pdf/2012.12877v1.pdf

Models trained with Implementation:

Release files for transformer-implementations 0.0.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for transformer-implementations 0.0.7
File Size Uploaded
transformer_implementations-0.0.7.tar.gz 5.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for transformer-implementations 0.0.7
File Interpreter ABI Platform
transformer_implementations-0.0.7-py3-none-any.whl Python 3 none any Details

Total release size: 19.2 kB

Release files / transformer_implementations-0.0.7.tar.gz

Download URL transformer_implementations-0.0.7.tar.gz
Size 5.8 kB
Tags Source
SHA-256 checksum
How to use checksums
bc5ba1f27acffc933df2a6ff87869c7b0d7cb81712c2f377ec774dd4960b6527
BLAKE2b-256 checksum
How to use checksums
1015eae44a41a36fc56c4e9968bb14a4477b6c31c6e9d78c24de5ef7e8fefcf3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/51.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.7.8

Release files / transformer_implementations-0.0.7-py3-none-any.whl

Download URL transformer_implementations-0.0.7-py3-none-any.whl
Size 13.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
5bde6543cdd5e96e10a99df555152465dccdd5b994aaf6ee096f6ad987816abb
BLAKE2b-256 checksum
How to use checksums
cf7f27e49fb1b519f21ed10453b52c003bb0bc5ac11e67ac702dcf7e6243bc5d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/51.0.0 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.7.8

Release history Release notifications | RSS feed

0.0.9

2 release files

0.0.8

2 release files

This release

0.0.7 This release

2 release files

0.0.6

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page