Early-Signal Detector

method · first seen 8 Oct 2026

weight decay

Also: AdamW weight decay, weight norm control, decoupled weight decay

Regularization that penalizes large parameter values by shrinking weights during training.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Muon optimizerlow-rank approximationgradient clippingMamba