method · first seen 7 Oct 2026
spectral analysis of pretrained weights
Also: weight spectral statistics
Using singular value spectra of model weight matrices to predict properties such as out-of-distribution robustness.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Pretraining Shapes Spectral Structure: Architecture- and Strategy-Conditional Prediction of OOD Robustness in Foundation ModelsPapers · 7 Oct 2026 · Sangyoon Bae, Sk Miraj Ahmed, Shinjae Yoo, Jiook Cha
Latest sources
- Pretraining Shapes Spectral Structure: Architecture- and Strategy-Conditional Prediction of OOD Robustness in Foundation ModelsPapers · 7 Oct 2026 · Sangyoon Bae, Sk Miraj Ahmed, Shinjae Yoo, Jiook Cha