Skip to main content
Avatar for Phil from gravatar.com

Phil

Username    lucidrains
Date joined   Joined

70 projects

geometric-vector-perceptron

Last released on

Geometric Vector Perceptron - Pytorch

egnn-pytorch

Last released on

E(n)-Equivariant Graph Neural Network - Pytorch

En-transformer

Last released on

E(n)-Equivariant Transformer

glom-pytorch

Last released on

Glom - Pytorch

dalle-pytorch

Last released on

DALL-E - Pytorch

alphafold2-pytorch

Last released on

AlphaFold2 - Pytorch

performer-pytorch

Last released on

Performer - Pytorch

perceiver-pytorch

Last released on

Perceiver - Pytorch

transformer-in-transformer

Last released on

Transformer in Transformer - Pytorch

coco-lm-pytorch

Last released on

COCO - Pytorch

x-transformers

Last released on

X-Transformers - Pytorch

omninet-pytorch

Last released on

Omninet - Pytorch

feedback-transformer-pytorch

Last released on

Implementation of Feedback Transformer in Pytorch

lightweight-gan

Last released on

Lightweight GAN

deep-daze

Last released on

Deep Daze

big-sleep

Last released on

Big Sleep

reformer-pytorch

Last released on

Reformer, the Efficient Transformer, Pytorch

se3-transformer-pytorch

Last released on

SE3 Transformer - Pytorch

vit-pytorch

Last released on

Vision Transformer (ViT) - Pytorch

nystrom-attention

Last released on

Nystrom Attention - Pytorch

pi-gan-pytorch

Last released on

π-GAN - Pytorch

siren-pytorch

Last released on

Implicit Neural Representations with Periodic Activation Functions

tr-rosetta-pytorch

Last released on

trRosetta - Pytorch

lie-transformer-pytorch

Last released on

Lie Transformer - Pytorch

byol-pytorch

Last released on

Self-supervised contrastive learning made simple

timesformer-pytorch

Last released on

TimeSformer - Pytorch

point-transformer-pytorch

Last released on

Point Transformer - Pytorch

memory-compressed-attention

Last released on

Memory-Compressed Self Attention

routing-transformer

Last released on

Routing Transformer (Pytorch)

pixel-level-contrastive-learning

Last released on

Pixel-Level Contrastive Learning

slot-attention

Last released on

Implementation of Slot Attention in Pytorch

bottleneck-transformer-pytorch

Last released on

Bottleneck Transformer - Pytorch

compressive-transformer-pytorch

Last released on

Implementation of Compressive Transformer in Pytorch

local-attention

Last released on

Local windowed attention, for language modeling

axial-attention

Last released on

Axial Attention

stylegan2-pytorch

Last released on

StyleGan2 in Pytorch

marge-pytorch

Last released on

Marge - Pytorch

dalle-pytorch-dev

Last released on

DALL-E - Pytorch

esbn-pytorch

Last released on

Emergent Symbol Binding Network - Pytorch

tab-transformer-pytorch

Last released on

Tab Transformer - Pytorch

conformer

Last released on

The convolutional module from the Conformer paper

sinkhorn-transformer

Last released on

Sinkhorn Transformer - Sparse Sinkhorn Attention

linear-attention-transformer

Last released on

Linear Attention Transformer

cross-transformers-pytorch

Last released on

Cross Transformers - Pytorch

adjacent-attention-pytorch

Last released on

Adjacent Attention Network - Pytorch

isab-pytorch

Last released on

Induced Set Attention Block - Pytorch

linformer

Last released on

Linformer implementation in Pytorch

molecule-attention-transformer

Last released on

Molecule Attention Transformer - Pytorch

gsa-pytorch

Last released on

Global Self-attention Network (GSA) - Pytorch

lambda-networks

Last released on

Lambda Networks - Pytorch

memformer

Last released on

Memformer - Pytorch

hamburger-pytorch

Last released on

Hamburger - Pytorch

unet-stylegan2

Last released on

StyleGan2 with UNet Discriminator, in Pytorch

aoa-pytorch

Last released on

Attention on Attention - Pytorch

vector-quantize-pytorch

Last released on

Simple Vector Quantization, in Pytorch

mixture-of-experts

Last released on

Sparsely-Gated Mixture of Experts for Pytorch

deep-linear-network

Last released on

Deep Linear Network - Pytorch

denoising-diffusion-pytorch

Last released on

Denoising Diffusion Probabilistic Models - Pytorch

kronecker-attention-pytorch

Last released on

Kronecker Attention - Pytorch

electra-pytorch

Last released on

Electra - Pytorch

attention-tensorflow-mesh

Last released on

A bunch of attention related functions, for constructing transformers in tensorflow mesh

mlm-pytorch

Last released on

MLM (Masked Language Modeling) - Pytorch

memory-transformer-xl

Last released on

Memory Transformer-XL, a variant of Transformer-XL that uses linear attention update long term memory

scattering-transform

Last released on

Scattering Transform module from the paper Scattering Compositional Learner

relay-transformer

Last released on

Relay Transformer, a long-range transformer

mogrifier

Last released on

Implementation of Mogrifier circuit from Deepmind

axial-positional-embedding

Last released on

Axial Positional Embedding

product-key-memory

Last released on

Product Key Memory

linear-attention

Last released on

Linear Attention Transformer

contrastive-learner

Last released on

Self-supervised contrastive learning made simple

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page