method · first seen 12 Nov 2026
SOAP optimizer
Also: ShampooAdam preconditioning
A second-order optimizer that runs Adam in the eigenbasis of Shampoo-style Kronecker preconditioners.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Factored One-sided Adam-Moment for Practical and Scalable SOAPPapers · 12 Nov 2026 · Jaemyung Yu, Byeongho Heo, Sangdoo Yun, Dongyoon Han
Latest sources
- Factored One-sided Adam-Moment for Practical and Scalable SOAPPapers · 12 Nov 2026 · Jaemyung Yu, Byeongho Heo, Sangdoo Yun, Dongyoon Han