method · first seen 4 Oct 2026
variance reduction
Also: SVRG
Techniques that reduce the variance of stochastic gradient estimates to speed up convergence of stochastic optimization.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Optimal Oracle Complexity for Finite-Sum Monotone InclusionsPapers · 4 Oct 2026 · Qihao Zhou
- Adaptive Variance Reduction across Smoothness and Noise ConditionsPapers · 9 Oct 2026 · Wei Jiang, Yibo Wang, Sifan Yang, Lijun Zhang, Zechao Li
- Accelerating Finite-Sum Bilevel Optimization with Fully First-Order OraclesPapers · 17 Oct 2026 · Qihao Zhou, Shanshui Niu
- Variance Reduction with Delayed Feedback for Non-Convex OptimizationPapers · 20 Oct 2026 · Wei Jiang, Dingzhi Yu, Zechao Li
- Variance Reduction for Decentralized Stochastic Optimization with Multiple Local UpdatesPapers · 30 Oct 2026 · Jie Liu, Nicola Bastianello, Wenying Xu, Daniel W. C. Ho, Karl H. Johansson
- Optimistic Gradient Algorithms with Randomized Coordinate and Variance Reduction Strategies for Composite InclusionsPapers · 30 Oct 2026 · Nghĩa Nguyen-Trung, Ion Necoara, Quoc Tran-Dinh
Latest sources
- Variance-Reduced Stochastic Hessian-Driven Nesterov Acceleration with Adam-Style PreconditioningPapers · 8 Nov 2026 · Yaxin Yu, Long Chen, Minfu Feng
- Compressed Per-Player Local Methods for Multiplayer Federated Learning: Exact Convergence via Increment SharingPapers · 5 Nov 2026 · Bhavika Balani, TaeHo Yoon, Nicolas Loizou
- Descending Everest, Part II: Oracle Complexity of Minimizing a Sum of Convex $(L_0,L_1)$-Smooth FunctionsPapers · 3 Nov 2026 · Mikhail Rudomanov, Ivan Fomin, Alexander V. Gasnikov, Fedor S. Stonyakin
- Optimistic Gradient Algorithms with Randomized Coordinate and Variance Reduction Strategies for Composite InclusionsPapers · 30 Oct 2026 · Nghĩa Nguyen-Trung, Ion Necoara, Quoc Tran-Dinh
- Variance Reduction for Decentralized Stochastic Optimization with Multiple Local UpdatesPapers · 30 Oct 2026 · Jie Liu, Nicola Bastianello, Wenying Xu, Daniel W. C. Ho, Karl H. Johansson
- Variance Reduction with Delayed Feedback for Non-Convex OptimizationPapers · 20 Oct 2026 · Wei Jiang, Dingzhi Yu, Zechao Li
- Accelerating Finite-Sum Bilevel Optimization with Fully First-Order OraclesPapers · 17 Oct 2026 · Qihao Zhou, Shanshui Niu
- Adaptive Variance Reduction across Smoothness and Noise ConditionsPapers · 9 Oct 2026 · Wei Jiang, Yibo Wang, Sifan Yang, Lijun Zhang, Zechao Li
- Optimal Oracle Complexity for Finite-Sum Monotone InclusionsPapers · 4 Oct 2026 · Qihao Zhou