Early-Signal Detector

phenomenon · first seen 15 Oct 2026

learning rate transfer

The phenomenon that optimal learning rates carry across model sizes or settings, studied to understand hyperparameter scaling.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

edge of stability