method · first seen 13 Oct 2026
clipped stochastic gradient descent
Also: clipped SGD
SGD variant that clips gradient norms to limit the influence of large noisy gradients, used under heavy-tailed noise.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Last-Iterate Convergence of Clipped SGD with Linear DecayPapers · 13 Oct 2026 · Wei Jiang, Haomin Bai, Zechao Li
- The Cost of an Unknown Horizon for the Last Iterate of Clipped SGD under Heavy-Tailed NoisePapers · 24 Oct 2026 · Yuxing Peng, Zhiqing Tang, Weijia Jia
Latest sources
- The Cost of an Unknown Horizon for the Last Iterate of Clipped SGD under Heavy-Tailed NoisePapers · 24 Oct 2026 · Yuxing Peng, Zhiqing Tang, Weijia Jia
- Last-Iterate Convergence of Clipped SGD with Linear DecayPapers · 13 Oct 2026 · Wei Jiang, Haomin Bai, Zechao Li