method · first seen 19 Oct 2026
momentum in gradient descent
Optimization technique that accumulates past gradients to smooth and accelerate parameter updates.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Physics-Inspired Optimizers beyond the Edge of Stability: Period-Two Orbits and Delayed InstabilityPapers · 19 Oct 2026 · Alexander Itin
Latest sources
- Physics-Inspired Optimizers beyond the Edge of Stability: Period-Two Orbits and Delayed InstabilityPapers · 19 Oct 2026 · Alexander Itin