phenomenon · first seen 6 Oct 2026
length generalization
A model's ability to apply learned procedures to inputs or depths beyond those seen in training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Exact-Solution Volume and Length Generalization in TransformersPapers · 6 Oct 2026 · Yijia Jessica Zhu, David Chiang
- Learning to Extrapolate in Depth with Looped TransformersPapers · 10 Oct 2026 · Huitao Yang, Jianhao Huang, Zixuan Wang, Baharan Mirzasoleiman
- Transformers Learn Two Competing Sorting Algorithms, and Only One Length-GeneralizesPapers · 18 Oct 2026 · Khashayar Gatmiry, Nathan W. Henry, Chloe H. Su, Emmanuel Abbe, Samy Bengio, Mel…
- PAR: Progress-Aligned Recurrence for Length Generalization in State TrackingPapers · 20 Oct 2026 · Pan Wang, Yihao Hu, Guangyuan Dong, Yitong Lin, Hang Wang, Zimi Liu, Zhihao Wen,…
- Putting Transformer Theories to the TestPapers · 23 Oct 2026 · Awni Altabaa, Tobias Schnabel, Kiran Tomlinson
- Quantitative Generalization Bounds for Multi-Layer Transformers: A Few Long Strings can Beat Many Short OnesPapers · 26 Oct 2026 · Marius Henry, Michael Rizvi-Martel, Michael Hahn
Latest sources
- Differentiable Exact LearningPapers · 16 Nov 2026 · Hristo Papazov, Francesco D'Angelo, Nicolas Flammarion
- How Finite Brains Generalize Without Bound: Spatial Memory as a Universal ComputerPapers · 5 Nov 2026 · Yuhang He, Si Wu
- Attending to Memory Writes Reduces Seed Variability in Recurrent Length GeneralizationPapers · 3 Nov 2026 · Sungwoo Goo, Hwi-yeol Yun, Sangkeun Jung
- A Positional Realizability Theory of Length Generalization in Single-Head AttentionPapers · 30 Oct 2026 · Jiasong Han, Yunkai Chai, Jintao Wang
- Quantitative Generalization Bounds for Multi-Layer Transformers: A Few Long Strings can Beat Many Short OnesPapers · 26 Oct 2026 · Marius Henry, Michael Rizvi-Martel, Michael Hahn
- Putting Transformer Theories to the TestPapers · 23 Oct 2026 · Awni Altabaa, Tobias Schnabel, Kiran Tomlinson
- PAR: Progress-Aligned Recurrence for Length Generalization in State TrackingPapers · 20 Oct 2026 · Pan Wang, Yihao Hu, Guangyuan Dong, Yitong Lin, Hang Wang, Zimi Liu, Zhihao Wen,…
- Transformers Learn Two Competing Sorting Algorithms, and Only One Length-GeneralizesPapers · 18 Oct 2026 · Khashayar Gatmiry, Nathan W. Henry, Chloe H. Su, Emmanuel Abbe, Samy Bengio, Mel…
- Learning to Extrapolate in Depth with Looped TransformersPapers · 10 Oct 2026 · Huitao Yang, Jianhao Huang, Zixuan Wang, Baharan Mirzasoleiman
- Exact-Solution Volume and Length Generalization in TransformersPapers · 6 Oct 2026 · Yijia Jessica Zhu, David Chiang