trends.barnas.net

method · first seen 13 Oct 2026

whitening-based preconditioning

Preconditioning gradient updates by decorrelating and normalising their covariance structure.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Muon optimizerDiLoCo