trends.barnas.net

method · first seen 15 Oct 2026

local SGD

Also: local stochastic gradient descent

Distributed training where workers take several local optimization steps before periodically averaging parameters or updates.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Nesterov momentummean-square stability