Early-Signal Detector

method · first seen 12 Oct 2026

learning rate schedule

Also: LRD, optimizer tuning, stepsize schedule, learning rate decay, learning rate scheduling

A prescribed plan for how the learning rate and related training settings change over the course of training.

Mentions per week

0419 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Rank 200 on 2 Nov 2026 · 9 mentions in 28 days · 9 independent groups · papers · first seen 3 weeks ago · acceleration -0.83

Earliest sources

Latest sources

Mentioned together with

stochastic gradient descentwarmup-stable-decay scheduleKronecker-factored preconditioningmodel weight averagingSchedule-Free AdamWlow-rank adaptationMuon optimizermid-trainingrecursive self-improvementweight normalization