Complex Transformer
The open source implementation of the attention and transformer from "Building Blocks for a Complex-Valued Transformer Architecture" where they propose an an attention mechanism for complex valued signals or images such as MRI and remote sensing.
They present:
- complex valued scaled dot product attention
- complex valued layer normalization
- results show improved robustness to overfitting while maintaing performance wbhen compared to real valued transformer
Install
pip install ct
License
MIT
1 maintainer
Metadata
1 maintainer
Release files for complex-attn 0.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| complex_attn-0.0.3.tar.gz | 4.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| complex_attn-0.0.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 8.4 kB
Release files / complex_attn-0.0.3.tar.gz
| Download URL | complex_attn-0.0.3.tar.gz |
|---|---|
| Size | 4.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
309d55fd87dfccbe6dcb25fb186fad46cc5a02f9f732da463e2434dde4e853a6
|
|
BLAKE2b-256 checksum How to use checksums |
6456604a95193596e88713ad297f482f4ce90f8c0ea1e22af83da562d500ddcf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
|
Release files / complex_attn-0.0.3-py3-none-any.whl
| Download URL | complex_attn-0.0.3-py3-none-any.whl |
|---|---|
| Size | 4.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b810d00c848ab76e61ade9b225727c3bdf833555599a4f0e5d42a9d107c61008
|
|
BLAKE2b-256 checksum How to use checksums |
5874a55ee4d08f251f363b9233ba94171296566c341d5e64b2f3558d367fe31d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
|
