Skip to main content

Log Depth Recurrent Modeling (wip)

Explorations into the Log Depth Recurrent Modeling proposed by Yiqin Wang of Imperial College London

Citations

@misc{wang2026logdepthrecurrentlanguagemodeling,
    title    = {Log-Depth Recurrent Language Modeling},
    author   = {Yiqin Wang and Nuri Cingillioglu and Charles Pert},
    year     = {2026},
    eprint   = {2609.28212},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url      = {https://arxiv.org/abs/2609.28212},
}
@misc{shen2019orderedmemory,
    title   = {Ordered Memory},
    author  = {Yikang Shen and Shawn Tan and Arian Hosseini and Zhouhan Lin and Alessandro Sordoni and Aaron Courville},
    year    = {2019},
    eprint  = {1910.13466},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url     = {https://arxiv.org/abs/1910.13466},
}
@misc{pert2026lengthgeneralizationlogdepthrecurrent,
    title     = {Length Generalization with Log-Depth Recurrent Units},
    author    = {Charles Pert and Dalal Alrajeh and Alessandra Russo},
    year      = {2026},
    eprint    = {2605.26035},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url       = {https://arxiv.org/abs/2605.26035},
}

Release files for log-depth-recurrent-modeling 0.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for log-depth-recurrent-modeling 0.0.1
File Size Uploaded
log_depth_recurrent_modeling-0.0.1.tar.gz 5.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for log-depth-recurrent-modeling 0.0.1
File Interpreter ABI Platform
log_depth_recurrent_modeling-0.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 10.9 kB

Release files / log_depth_recurrent_modeling-0.0.1.tar.gz

Download URL log_depth_recurrent_modeling-0.0.1.tar.gz
Size 5.7 kB
Tags Source
SHA-256 checksum
How to use checksums
42e4e06dd08f6e7c1be267ed500257ef41b7c8af48a6775a86937ee8c18c563c
BLAKE2b-256 checksum
How to use checksums
650f36927fad0356964f162f3c373b7a523962afda187b41c7650501c733ea08
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release files / log_depth_recurrent_modeling-0.0.1-py3-none-any.whl

Download URL log_depth_recurrent_modeling-0.0.1-py3-none-any.whl
Size 5.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
aead2281fde27dbefb6574cc6b003f422d84f3dbfe2cdcf95a3c84ee1bf835fc
BLAKE2b-256 checksum
How to use checksums
67fd17340766a23f515f32129a8dd1a4ed22ea2a7678cbb967134cc4ca786e7a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release history Release notifications | RSS feed

0.0.5

2 release files

0.0.4

2 release files

0.0.2

2 release files

This release

0.0.1 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page