phenomenon · first seen 6 Oct 2026
grokking
Also: delayed generalization
Delayed generalization where a network suddenly generalizes long after it has fit the training data.
Mentions per week
PapersCodeDiscussion
Earliest sources
- How Learning Governs Unlearning across the Memorization-Generalization SpectrumPapers · 6 Oct 2026 · Hwiyeong Lee, Hyelim Lim, Ingyu Bang, Hoki Kim, Taeuk Kim
- Do Flatter Minima Drive Better Generalization? An Algorithmic Separation in GrokkingPapers · 8 Oct 2026 · Mohnish Harwani
- Probability-Signature Dynamics: Unpacking Modular Addition Learning Within Two-Layer NetworksPapers · 8 Oct 2026 · Yunji Wang, Junjie Yao, Linyu Liu, Pinyan Lu, Zhi-Qin John Xu
- Statistical Vignettes on the Grokking PhenomenonPapers · 13 Oct 2026 · Baye Malick Gning, Elvis Dohmatob
- Flat Loss, Evolving Features: Grokking in Modular AdditionPapers · 15 Oct 2026 · Akash Kumar, Karthik Sankaranarayanan
- Sample-efficient learning with Dense Associative MemoriesPapers · 19 Oct 2026 · Andrew Lucas, Dmitry Krotov
Latest sources
- Grokking Can Be Steered: Selecting Desirable Solutions By Choice Of Learning RulePapers · 14 Nov 2026 · Pascal Sager, Benjamin Grewe, Pau Vilimelis Aceituno, Thilo Stadelmann
- Deep Neural Networks Training Efficiency: Does Grokking Modify its Dynamics?Papers · 13 Nov 2026 · Eduardo Cueto-Mendoza, John D. Kelleher
- Are UFOs Real? Introducing Unified Factored OrganizersPapers · 9 Nov 2026 · Thomas X. Sheppard, Alon Albalak, Joel Lehman, Kenneth O. Stanley
- Dissecting Geometric Constraints in Grokking: Interaction-Dependent Acceleration in Modular ArithmeticPapers · 2 Nov 2026 · Zachary A. Hampton, Wasiq Khan, Bilal Khan
- Same Function, Different Mechanism: Implementation-Local Geometry Beyond AccuracyPapers · 31 Oct 2026 · Miroslav Lžičař
- Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of GrokkingPapers · 26 Oct 2026 · Min Chen, Junqi Wang, Zeguan Wu, Wenhao Huang, Junyu Liu
- Subspace Crystallization in Grokking: Rank Compression Tracks the Phase TransitionPapers · 26 Oct 2026 · Shlok Mehendale, Paras Chopra
- Mapping the Solution-Set Structure of Grokking on Latin SquaresPapers · 26 Oct 2026 · Zihan Gu, Lulu Zhao, Tianyi Ma, Hua Zhang, Wenbo Su, Yanan Cao, Yue Hu
- Generalization in Learning: Eyring Formula and Predator-prey ModelPapers · 25 Oct 2026 · S. V. Kozyrev, I. A. Lopatin, Alexander Pechen
- A Fix for Softmax and Cross-EntropyPapers · 22 Oct 2026 · Jonathan T. Barron, Dan Gnanapragasam, Michael Tschannen
- Foundations of the Scaling LawPapers · 20 Oct 2026 · Tianyu Zhao, Zhixiang Ren
- Sample-efficient learning with Dense Associative MemoriesPapers · 19 Oct 2026 · Andrew Lucas, Dmitry Krotov