phenomenon · first seen 9 Oct 2026
heavy-tailed noise
Also: Student-t distribution
Stochastic gradient noise with infinite or very large higher moments, which degrades standard SGD guarantees.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Robust Langevin Sampling under State-Dependent Heavy-Tailed Noise with Applications to LLM Fine-TuningPapers · 9 Oct 2026 · M. Berk Sahin, Ege C. Kaya, Arda Fazla, Behzad Sharif, Abolfazl Hashemi
- DAG Structure Learning with Node-Varying Heavy-Tailed DisturbancesPapers · 9 Oct 2026 · Robin Francis, Sundeep Prabhakar Chepuri
- Last-Iterate Convergence of Clipped SGD with Linear DecayPapers · 13 Oct 2026 · Wei Jiang, Haomin Bai, Zechao Li
- Weak-$L^α$ Noise, Strong Guarantees: Gradient Clipping under Affine Heavy TailsPapers · 20 Oct 2026 · Alyona Nekrasova, Makar Sidorov, Savelii Chezhegov, Alexander Gasnikov, Margarit…
- On the Convergence of Vanilla Adam under Heavy-Tailed Noise and Index SamplingPapers · 2 Nov 2026 · Kanata Oowada, Hideaki Iiduka
- Coordinatewise Epsilon for Adam under Heavy-Tailed NoisePapers · 6 Nov 2026 · Jeonseong Kim, Chenglin Fan
Latest sources
- Coordinatewise Epsilon for Adam under Heavy-Tailed NoisePapers · 6 Nov 2026 · Jeonseong Kim, Chenglin Fan
- On the Convergence of Vanilla Adam under Heavy-Tailed Noise and Index SamplingPapers · 2 Nov 2026 · Kanata Oowada, Hideaki Iiduka
- Weak-$L^α$ Noise, Strong Guarantees: Gradient Clipping under Affine Heavy TailsPapers · 20 Oct 2026 · Alyona Nekrasova, Makar Sidorov, Savelii Chezhegov, Alexander Gasnikov, Margarit…
- Last-Iterate Convergence of Clipped SGD with Linear DecayPapers · 13 Oct 2026 · Wei Jiang, Haomin Bai, Zechao Li
- DAG Structure Learning with Node-Varying Heavy-Tailed DisturbancesPapers · 9 Oct 2026 · Robin Francis, Sundeep Prabhakar Chepuri
- Robust Langevin Sampling under State-Dependent Heavy-Tailed Noise with Applications to LLM Fine-TuningPapers · 9 Oct 2026 · M. Berk Sahin, Ege C. Kaya, Arda Fazla, Behzad Sharif, Abolfazl Hashemi