method · first seen 14 Oct 2026
spectral clipping
Also: soft spectral clipping
Limiting the singular values of gradient matrices during training to stabilise optimisation.
Mentions per week
PapersCodeDiscussion
Earliest sources
- CAST: History-Adaptive Spectral Clipping for LLM PretrainingPapers · 14 Oct 2026 · Jiacheng Li, Jianchao Tan, Kefeng Zhang, Yuchen Xie, Xunliang Cai
Latest sources
- CAST: History-Adaptive Spectral Clipping for LLM PretrainingPapers · 14 Oct 2026 · Jiacheng Li, Jianchao Tan, Kefeng Zhang, Yuchen Xie, Xunliang Cai