method · first seen 20 Oct 2026
Polyak-Ruppert averaging
Also: iterate averaging, Polyak-Ruppert averaged stochastic approximation
A technique averaging SGD iterates to achieve optimal asymptotic covariance and faster convergence of stochastic optimization.
Mentions per week
PapersCodeDiscussion
Earliest sources
- From Generic to Dedicated: A Novel Optimizer for Online Continual LearningPapers · 20 Oct 2026 · Yongyi Wu, Zheng Wang, Sen Lin
- When Momentum Helps Polyak--Ruppert AveragingPapers · 20 Oct 2026 · Alexandra Suvorikova, Darina Dvinskikh, Yuriy Dorn, Alexander Gasnikov
- Riemannian Newton Methods with Statistical InferencePapers · 31 Oct 2026 · Xiaotian Chang, Qirui Hu, Yangdi Jiang, Nan Qiao
- Lower Bounds on Inference Complexity for Polyak-Ruppert Averaged Stochastic Gradient DescentPapers · 31 Oct 2026 · Denis Belomestny, Alexey Naumov, Sergey Samsonov
- Sharp Gaussian approximation for Polyak--Ruppert averaged linear stochastic approximationPapers · 11 Nov 2026 · Bogdan Butyrin, Eric Moulines, Alexey Naumov, Sergey Samsonov
- Sharp Gaussian Approximation for Q-LearningPapers · 15 Nov 2026 · Xingtu Liu
Latest sources
- Federated TD Learning in Heterogeneous Environments with Average Rewards: A Two-timescale Approach with Polyak-Ruppert AveragingPapers · 16 Nov 2026 · Ankur Naskar, Gugan Thoppe, Abbasali Koochakzadeh, Vijay Gupta
- Sharp Gaussian Approximation for Q-LearningPapers · 15 Nov 2026 · Xingtu Liu
- Sharp Gaussian approximation for Polyak--Ruppert averaged linear stochastic approximationPapers · 11 Nov 2026 · Bogdan Butyrin, Eric Moulines, Alexey Naumov, Sergey Samsonov
- Lower Bounds on Inference Complexity for Polyak-Ruppert Averaged Stochastic Gradient DescentPapers · 31 Oct 2026 · Denis Belomestny, Alexey Naumov, Sergey Samsonov
- Riemannian Newton Methods with Statistical InferencePapers · 31 Oct 2026 · Xiaotian Chang, Qirui Hu, Yangdi Jiang, Nan Qiao
- When Momentum Helps Polyak--Ruppert AveragingPapers · 20 Oct 2026 · Alexandra Suvorikova, Darina Dvinskikh, Yuriy Dorn, Alexander Gasnikov
- From Generic to Dedicated: A Novel Optimizer for Online Continual LearningPapers · 20 Oct 2026 · Yongyi Wu, Zheng Wang, Sen Lin