Early-Signal Detector

phenomenon · first seen 6 Oct 2026

grokking

Also: delayed generalization

Delayed generalization where a network suddenly generalizes long after it has fit the training data.

Mentions per week

0619 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

LLM unlearningsharpness-aware minimizationdiscrete Fourier transformmodern Hopfield networksscaling lawcross-entropy lossstochastic gradient Langevin Monte Carloeffective rank compression of weight matricesmodular arithmetic task for transformersrenormalization group