Early-Signal Detector

method · first seen 7 Oct 2026

matrix orthogonalization in optimizers

Updating weight matrices with orthogonalized gradients, normalizing singular values to improve training.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Muon optimizerNewton-Schulz iteration