Early-Signal Detector

method · first seen 6 Oct 2026

Shampoo optimizer

Also: SOAP, Shampoo, Matrix Shampoo, matrix-structured optimizer

A preconditioned stochastic optimizer that uses Kronecker-factored second-order statistics of gradients.

Mentions per week

0319 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Muon optimizerBregman divergencefrequent directionsadaptive subgradient methodsnonstationary stochastic optimizationAdamzeroth-order optimizationSOAP optimizerknowledge distillation