method · first seen 29 Oct 2026
weight normalization
Also: WN
Reparameterization that decouples weight norm from direction, often used as an alternative to explicit weight decay.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-Normalized TrainingPapers · 29 Oct 2026 · Qifan Yu, Xinyu Ma, Xingyan Bin, Di He
Latest sources
- Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-Normalized TrainingPapers · 29 Oct 2026 · Qifan Yu, Xinyu Ma, Xingyan Bin, Di He