method · first seen 12 Oct 2026
warmup-stable-decay schedule
Also: WSD schedule
A learning-rate schedule with warmup, a constant plateau, and a final cooldown phase.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Asymptotic Risk of Learning-Rate Schedules for Least-Squares Regression with Discretely Distributed FeaturesPapers · 12 Oct 2026 · Noé Colomban, Francis Bach, Fabian Schaipp
Latest sources
- Asymptotic Risk of Learning-Rate Schedules for Least-Squares Regression with Discretely Distributed FeaturesPapers · 12 Oct 2026 · Noé Colomban, Francis Bach, Fabian Schaipp