phenomenon · first seen 5 Oct 2026
implicit bias of gradient descent
The tendency of gradient-based training to converge to particular solutions among many that fit the data.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The Implicit Bias of Hyperbolic Representation Learning for Multiclass Data: A Busemann Risk PerspectivePapers · 5 Oct 2026 · Xingrun Li, Sho Kuno, Yusuke Mukuta, Xin Yang, Tatsuya Harada
- From Spectral to Frobenius: When Muon Loses Its Spectral Implicit BiasPapers · 14 Oct 2026 · Yongtao Wu, Mahdi Mansouri, Zhenyu Zhu
- A Minimal ReLU Classifier on Non-Linearly Separable Data: Convergence and Implicit Bias at and beyond the Edge of StabilityPapers · 16 Oct 2026 · Quan Nguyen, Robin Yadav, Param Mody, Mark Schmidt
- Watch Your Step: Adam's Margin Maximization Bias Depends on the Learning Rate SchedulePapers · 1 Nov 2026 · Eitan Gronich, Gal Vardi
- Adversarial Training with Large Step Sizes: Implicit Bias, Optimization, and SharpnessPapers · 5 Nov 2026 · Yi Feng, Andrea Paudice
- Implicit Bias in State Space Models and Linear Autoregressive TrainingPapers · 6 Nov 2026 · Gal Katzhendler, Gilad Yehudai, Gal Vardi
Latest sources
- Implicit Bias in State Space Models and Linear Autoregressive TrainingPapers · 6 Nov 2026 · Gal Katzhendler, Gilad Yehudai, Gal Vardi
- Adversarial Training with Large Step Sizes: Implicit Bias, Optimization, and SharpnessPapers · 5 Nov 2026 · Yi Feng, Andrea Paudice
- Watch Your Step: Adam's Margin Maximization Bias Depends on the Learning Rate SchedulePapers · 1 Nov 2026 · Eitan Gronich, Gal Vardi
- A Minimal ReLU Classifier on Non-Linearly Separable Data: Convergence and Implicit Bias at and beyond the Edge of StabilityPapers · 16 Oct 2026 · Quan Nguyen, Robin Yadav, Param Mody, Mark Schmidt
- From Spectral to Frobenius: When Muon Loses Its Spectral Implicit BiasPapers · 14 Oct 2026 · Yongtao Wu, Mahdi Mansouri, Zhenyu Zhu
- The Implicit Bias of Hyperbolic Representation Learning for Multiclass Data: A Busemann Risk PerspectivePapers · 5 Oct 2026 · Xingrun Li, Sho Kuno, Yusuke Mukuta, Xin Yang, Tatsuya Harada