phenomenon · first seen 15 Oct 2026
learning rate transfer
The phenomenon that optimal learning rates carry across model sizes or settings, studied to understand hyperparameter scaling.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Measuring the local shape of learning-rate transfer curvesPapers · 15 Oct 2026 · Satoki Ishikawa, Rio Yokota, Ryo Karakida
Latest sources
- Measuring the local shape of learning-rate transfer curvesPapers · 15 Oct 2026 · Satoki Ishikawa, Rio Yokota, Ryo Karakida