trends.barnas.net

method · first seen 20 Oct 2026

Polyak-Ruppert averaging

Also: iterate averaging, Polyak-Ruppert averaged stochastic approximation

A technique averaging SGD iterates to achieve optimal asymptotic covariance and faster convergence of stochastic optimization.

Mentions per week

0319 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

online continual learningNesterov momentumRiemannian Newton methodstochastic gradient descentrecursive multiplier bootstrapQ-learningfederated reinforcement learningtwo-timescale stochastic approximation