Skip to main content

Log Depth Recurrent Modeling (wip)

Explorations into the Log Depth Recurrent Modeling proposed by Yiqin Wang of Imperial College London

Citations

@misc{wang2026logdepthrecurrentlanguagemodeling,
    title    = {Log-Depth Recurrent Language Modeling},
    author   = {Yiqin Wang and Nuri Cingillioglu and Charles Pert},
    year     = {2026},
    eprint   = {2609.28212},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url      = {https://arxiv.org/abs/2609.28212},
}
@misc{shen2019orderedmemory,
    title   = {Ordered Memory},
    author  = {Yikang Shen and Shawn Tan and Arian Hosseini and Zhouhan Lin and Alessandro Sordoni and Aaron Courville},
    year    = {2019},
    eprint  = {1910.13466},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url     = {https://arxiv.org/abs/1910.13466},
}
@misc{pert2026lengthgeneralizationlogdepthrecurrent,
    title     = {Length Generalization with Log-Depth Recurrent Units},
    author    = {Charles Pert and Dalal Alrajeh and Alessandra Russo},
    year      = {2026},
    eprint    = {2605.26035},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url       = {https://arxiv.org/abs/2605.26035},
}

Release files for log-depth-recurrent-modeling 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for log-depth-recurrent-modeling 0.0.2
File Size Uploaded
log_depth_recurrent_modeling-0.0.2.tar.gz 6.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for log-depth-recurrent-modeling 0.0.2
File Interpreter ABI Platform
log_depth_recurrent_modeling-0.0.2-py3-none-any.whl Python 3 none any Details

Total release size: 11.4 kB

Release files / log_depth_recurrent_modeling-0.0.2.tar.gz

Download URL log_depth_recurrent_modeling-0.0.2.tar.gz
Size 6.0 kB
Tags Source
SHA-256 checksum
How to use checksums
6601060607260680c18d6c3ecf8f362dff00f9043bf51223248367fd9c09b153
BLAKE2b-256 checksum
How to use checksums
5601ebe0baa3214c0f569e8dc0188c8704daf1cab0b1d7d7f032f46209d1c5a4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release files / log_depth_recurrent_modeling-0.0.2-py3-none-any.whl

Download URL log_depth_recurrent_modeling-0.0.2-py3-none-any.whl
Size 5.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
52451b7094c865e4eb2330711a910c87c23083aaac0ac1045e45b8a652f29e6e
BLAKE2b-256 checksum
How to use checksums
cafcf8ef316c1c6a0d0bc077d38a477579a05cde2848305114ebb95da602ee6e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release history Release notifications | RSS feed

0.0.5

2 release files

0.0.4

2 release files

This release

0.0.2 This release

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page