method · first seen 7 Oct 2026
matrix orthogonalization in optimizers
Updating weight matrices with orthogonalized gradients, normalizing singular values to improve training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Spectrally Targeted MuonPapers · 7 Oct 2026 · Vishrut Goyal, Rohan Ramkumar
Latest sources
- Spectrally Targeted MuonPapers · 7 Oct 2026 · Vishrut Goyal, Rohan Ramkumar