method · first seen 15 Oct 2026
local SGD
Also: local stochastic gradient descent
Distributed training where workers take several local optimization steps before periodically averaging parameters or updates.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Understanding Stability of Outer Nesterov Momentum on Stochastic Pseudo-GradientsPapers · 15 Oct 2026 · Nishant Sharma, Laura Gomezjurado Gonzalez, Ganesh Talluri, Sarath Chandar, Hiro…
Latest sources
- Understanding Stability of Outer Nesterov Momentum on Stochastic Pseudo-GradientsPapers · 15 Oct 2026 · Nishant Sharma, Laura Gomezjurado Gonzalez, Ganesh Talluri, Sarath Chandar, Hiro…