trends.barnas.net

method · first seen 9 Oct 2026

Schedule-Free AdamW

Also: Schedule-Free optimizer, schedule-free optimization

An AdamW variant that removes the need for a learning-rate schedule by combining iterate averaging with momentum.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

hyperparameter tuningAlgoPerf benchmarklearning rate schedulemodel weight averaging