Skip to main content

RLT (wip)

Unofficial implementation of the Recurrent Looped Transformer proposed by Yifan Zhang of Princeton.

Will also do some exploration of the Recurrent Transformer proposed by Costin-Andrei Oncescu et al. of Harvard, if I have any remaining time

Citations

@techreport{zhang2026recurrentlooped,
    title  = {Recurrent Looped Transformer},
    author = {Zhang, Yifan},
    year   = {2026},
    month  = {Sep},
    url    = {https://github.com/yifanzhang-pro/recurrent-looped-tranformer}
}
@misc{oncescu2026recurrenttransformergreatereffective,
    title     = {The Recurrent Transformer: Greater Effective Depth and Efficient Decoding},
    author    = {Costin-Andrei Oncescu and Depen Morwani and Samy Jelassi and Alexandru Meterez and Mujin Kwun and Sham Kakade},
    year      = {2026},
    eprint    = {2604.21215},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url       = {https://arxiv.org/abs/2604.21215},
}

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rlt_pytorch-0.0.8.tar.gz (7.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rlt_pytorch-0.0.8-py3-none-any.whl (6.9 kB view details)

Uploaded Python 3

File details

Details for the file rlt_pytorch-0.0.8.tar.gz.

File metadata

  • Download URL: rlt_pytorch-0.0.8.tar.gz
  • Upload date:
  • Size: 7.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.17

File hashes

Hashes for rlt_pytorch-0.0.8.tar.gz
Algorithm Hash digest
SHA256 edad1e7d15759672c11ec668873a654881d485a97a83e658e3ab3cdcb18ccda1
MD5 15c5976784b3e35dfa8b74ffa0a6b14b
BLAKE2b-256 3f11fed58caf01df4c2b93e8dcd9d0a53f11e0ca9a573b42f818e17686aad040

See more details on using hashes here.

File details

Details for the file rlt_pytorch-0.0.8-py3-none-any.whl.

File metadata

File hashes

Hashes for rlt_pytorch-0.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 b30365eaf5c37886ff3ac08dd813479de0f1295ae1da7e2a03e877dd5d72ec45
MD5 192f658cbf06aef9751ba557c18e96ed
BLAKE2b-256 6ffad2fc5b62cc6435a2e4694b0c049a45aa36ac6a56c9fd9d52d146fdafb001

See more details on using hashes here.

Release history Release notifications | RSS feed

0.0.14

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

This release

0.0.8 This release

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page