70 projects
geometric-vector-perceptron
Geometric Vector Perceptron - Pytorch
egnn-pytorch
E(n)-Equivariant Graph Neural Network - Pytorch
En-transformer
E(n)-Equivariant Transformer
glom-pytorch
Glom - Pytorch
dalle-pytorch
DALL-E - Pytorch
alphafold2-pytorch
AlphaFold2 - Pytorch
performer-pytorch
Performer - Pytorch
perceiver-pytorch
Perceiver - Pytorch
transformer-in-transformer
Transformer in Transformer - Pytorch
coco-lm-pytorch
COCO - Pytorch
x-transformers
X-Transformers - Pytorch
omninet-pytorch
Omninet - Pytorch
feedback-transformer-pytorch
Implementation of Feedback Transformer in Pytorch
lightweight-gan
Lightweight GAN
deep-daze
Deep Daze
big-sleep
Big Sleep
reformer-pytorch
Reformer, the Efficient Transformer, Pytorch
se3-transformer-pytorch
SE3 Transformer - Pytorch
vit-pytorch
Vision Transformer (ViT) - Pytorch
nystrom-attention
Nystrom Attention - Pytorch
pi-gan-pytorch
π-GAN - Pytorch
siren-pytorch
Implicit Neural Representations with Periodic Activation Functions
tr-rosetta-pytorch
trRosetta - Pytorch
lie-transformer-pytorch
Lie Transformer - Pytorch
byol-pytorch
Self-supervised contrastive learning made simple
timesformer-pytorch
TimeSformer - Pytorch
point-transformer-pytorch
Point Transformer - Pytorch
memory-compressed-attention
Memory-Compressed Self Attention
routing-transformer
Routing Transformer (Pytorch)
pixel-level-contrastive-learning
Pixel-Level Contrastive Learning
slot-attention
Implementation of Slot Attention in Pytorch
bottleneck-transformer-pytorch
Bottleneck Transformer - Pytorch
compressive-transformer-pytorch
Implementation of Compressive Transformer in Pytorch
local-attention
Local windowed attention, for language modeling
axial-attention
Axial Attention
stylegan2-pytorch
StyleGan2 in Pytorch
marge-pytorch
Marge - Pytorch
dalle-pytorch-dev
DALL-E - Pytorch
esbn-pytorch
Emergent Symbol Binding Network - Pytorch
tab-transformer-pytorch
Tab Transformer - Pytorch
conformer
The convolutional module from the Conformer paper
sinkhorn-transformer
Sinkhorn Transformer - Sparse Sinkhorn Attention
linear-attention-transformer
Linear Attention Transformer
cross-transformers-pytorch
Cross Transformers - Pytorch
adjacent-attention-pytorch
Adjacent Attention Network - Pytorch
isab-pytorch
Induced Set Attention Block - Pytorch
linformer
Linformer implementation in Pytorch
molecule-attention-transformer
Molecule Attention Transformer - Pytorch
gsa-pytorch
Global Self-attention Network (GSA) - Pytorch
lambda-networks
Lambda Networks - Pytorch
memformer
Memformer - Pytorch
hamburger-pytorch
Hamburger - Pytorch
unet-stylegan2
StyleGan2 with UNet Discriminator, in Pytorch
aoa-pytorch
Attention on Attention - Pytorch
vector-quantize-pytorch
Simple Vector Quantization, in Pytorch
mixture-of-experts
Sparsely-Gated Mixture of Experts for Pytorch
deep-linear-network
Deep Linear Network - Pytorch
denoising-diffusion-pytorch
Denoising Diffusion Probabilistic Models - Pytorch
kronecker-attention-pytorch
Kronecker Attention - Pytorch
electra-pytorch
Electra - Pytorch
attention-tensorflow-mesh
A bunch of attention related functions, for constructing transformers in tensorflow mesh
mlm-pytorch
MLM (Masked Language Modeling) - Pytorch
memory-transformer-xl
Memory Transformer-XL, a variant of Transformer-XL that uses linear attention update long term memory
scattering-transform
Scattering Transform module from the paper Scattering Compositional Learner
relay-transformer
Relay Transformer, a long-range transformer
mogrifier
Implementation of Mogrifier circuit from Deepmind
axial-positional-embedding
Axial Positional Embedding
product-key-memory
Product Key Memory
linear-attention
Linear Attention Transformer
contrastive-learner
Self-supervised contrastive learning made simple
