phenomenon · first seen 17 Oct 2026
low-rank simplicity bias
The tendency of deep networks during training to learn representations of low effective rank.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Representations Have Trajectories: Characterizing Temporal Representation Dynamics in Neural NetworksPapers · 17 Oct 2026 · Shivaprasad B. Gowda, Sparsh Mittal
Latest sources
- Representations Have Trajectories: Characterizing Temporal Representation Dynamics in Neural NetworksPapers · 17 Oct 2026 · Shivaprasad B. Gowda, Sparsh Mittal