method · first seen 12 Oct 2026
sign-based optimizer
Also: signSGD, sign descent
Optimization methods that update parameters using only the sign of gradients rather than their magnitude.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Which Geometry on Which Layer? Measured Sign-Spectral Assignment in Mixed-Optimizer TrainingPapers · 12 Oct 2026 · Hiroki Naganuma, Laura Gomezjurado, Mahdi Ghaznavi, Ganesh Talluri, Atsushi Nita…
- ZEMA: confidence-calibrated signed descent with only one statePapers · 3 Nov 2026 · Ali Dadsetan, Domenic Rosati, Frank Rudzicz
- When and How SignSGD Outperforms SGD: A Functional Scaling Law PerspectivePapers · 12 Nov 2026 · Zilin Wang, Binghui Li, Jia-Nan Wang, Lean Wang, Jinbo Wang, Lei Wu
Latest sources
- When and How SignSGD Outperforms SGD: A Functional Scaling Law PerspectivePapers · 12 Nov 2026 · Zilin Wang, Binghui Li, Jia-Nan Wang, Lean Wang, Jinbo Wang, Lei Wu
- ZEMA: confidence-calibrated signed descent with only one statePapers · 3 Nov 2026 · Ali Dadsetan, Domenic Rosati, Frank Rudzicz
- Which Geometry on Which Layer? Measured Sign-Spectral Assignment in Mixed-Optimizer TrainingPapers · 12 Oct 2026 · Hiroki Naganuma, Laura Gomezjurado, Mahdi Ghaznavi, Ganesh Talluri, Atsushi Nita…