method · first seen 9 Oct 2026
normalized momentum
A momentum update that normalizes the gradient step to control scale in stochastic optimization.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Adaptive Variance Reduction across Smoothness and Noise ConditionsPapers · 9 Oct 2026 · Wei Jiang, Yibo Wang, Sifan Yang, Lijun Zhang, Zechao Li
Latest sources
- Adaptive Variance Reduction across Smoothness and Noise ConditionsPapers · 9 Oct 2026 · Wei Jiang, Yibo Wang, Sifan Yang, Lijun Zhang, Zechao Li