architecture · first seen 4 Oct 2026
looped transformer
Also: LoopLM, looped model, layer looping, latent looping, parameter tying, layer repetition, looped reasoning, selective looping
A transformer that reuses shared blocks over repeated recurrent loops to increase depth without adding parameters.
Looped transformers reuse one shared block, or a small stack of blocks, over several recurrent passes, so effective depth grows without adding parameters. Recent arXiv work has shifted from asking whether looping helps reasoning to making it practical. A Hochreiter-group paper and a Qualcomm-affiliated paper target the per-loop KV-cache memory that blocks dynamic depth in models like Ouro. LoopFill applies speculative decoding to cut decoding latency. Rectified and flow-inspired variants stabilize hidden states across loops, and energy-based papers propose principled stopping rules. The idea is also spreading beyond language, into diffusion (LiFT), MRI reconstruction and multimodal embeddings, along with a few small open-source repos.
If the cache, latency and stability problems get solved, looped models could offer adjustable test-time compute per token from a single small checkpoint, an alternative to generating chain-of-thought tokens. The energy-based critiques suggest the design is still unsettled, so it is worth watching which formulation wins.
Analyst note (emerging), 17 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 20 on 16 Nov 2026 · 37 mentions in 28 days · 34 independent groups · papers → code · first seen 6 weeks ago · acceleration +0.02
Earliest sources
- LiFT: Loop Flow TransformersPapers · 4 Oct 2026 · Mohammad Mahdi Derakhshani, Pedro M. P. Curvo, Gertjan J. Burghouts, Jan-Willem…
- Recurrent Looped TransformerPapers · 6 Oct 2026 · Yifan Zhang, Jichen Feng, Shihan Qin, Sun-Yuan Kung, Mengdi Wang
- SanSi: A Looped Typed Decision Model for System 1.5 ThinkingPapers · 6 Oct 2026 · Shuyu Gan, Young-Jun Lee, Dongyeop Kang
- Enabling Dynamic Computation in Looped LMsPapers · 6 Oct 2026 · Aayush Mishra, Arnau Padrés Masdemont, Victor Conchello Vendrell, Jordi Ros Gir…
- ResidualQuant: KV Cache Quantization for Looped Transformers with 2-Bit ResidualsPapers · 7 Oct 2026 · Heejun Kim, Junyoung Lee, SangLyul Cho, Dongsu Han, Insu Han, Sehoon Kim
- From Chain-of-Thought to Loops: Non-Autoregressive Latent Reasoning via Looped TransformersPapers · 8 Oct 2026 · Gerard Grau García, Arnau Padrés Masdemont, Niccolò Grillo, Jordi Ros-Giralt,…
Latest sources
- When Does Reusing Layers Help Multimodal Embeddings?Papers · 15 Nov 2026 · Zhizhang Hu, Yue Zhang
- LoopFill: Pipelined Multi-Token Speculative Decoding for Looped TransformersPapers · 14 Nov 2026 · Siqi Zhu, Suozhi Huang, Yi Zhao, Jiaxuan You
- Architectures and KV Replay for Depth-Recurrent Language ModelsPapers · 14 Nov 2026 · Lucia Licakova, Niklas Schmidinger, Lukas Hauzenberger, Sebastian Böck, Sepp Ho…
- Classical Energies Learn to Reason 1,000x Faster than Looped ModelsPapers · 12 Nov 2026 · Benjamin Hoover, Hugh Blayney, James C. R. Whittington
- Rectified Looped TransformerPapers · 12 Nov 2026 · Musheng Li, Jiawei Zhang, Ziyuan Liu, Yuantao Gu
- One Block Is Enough: LoopMR for Accelerated MRI ReconstructionPapers · 11 Nov 2026 · Yimeng He, Yibin Xie, Yi Zheng, Yifan Gao, Lixia Wang, Yin-Chen Hsu, Yufeng Wang…
- filliptm/solv3r-demoCode · 9 Nov 2026 · filliptm · 25 stars
- Energy-Based Reasoners: Your Recurrent Reasoner Should Be an Energy-Based ModelPapers · 6 Nov 2026 · William Xingxu Chen, Alexi Gladstone, Zeyu Michael Li, Heng Ji, Yilun Du
- Extending Reasoning in Typed Decision Models via LoopingPapers · 5 Nov 2026 · David Berghaus, Arber Zela, Behzad Shomali, Markus Frey, Mehdi Ali, Rafet Sifa,…
- Loopback Transformer: Towards a Unified View of Residual Looped TransformersPapers · 4 Nov 2026 · Xuan Ouyang, Zefan Cai, Chenlong Zhang, Cheng Luo, Ke Wan, Junjie Hu
- Not All Loops Cost the Same: Phase-Dependent Depth for Serving Looped TransformersPapers · 4 Nov 2026 · Zhixu Du, Yuhan Cheng, Hai "Helen" Li, Yiran Chen
- LooM: Loop-Invariant Memory for Causal Encoder-Decoder Language ModelsPapers · 4 Nov 2026 · Lele Yang, Muxi Diao, Zhonghao Yan, Jiankang Chen, Bin Wen, Tingting Gao, Wentao…