phenomenon · first seen 17 Oct 2026
representation collapse
Also: representation collapse prevention
Loss of rank or diversity in neural network representations during training, reducing effective capacity.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Representations Have Trajectories: Characterizing Temporal Representation Dynamics in Neural NetworksPapers · 17 Oct 2026 · Shivaprasad B. Gowda, Sparsh Mittal
- LocaLeJEPA: Maximum Entropy Representations under Geometric PriorsPapers · 20 Oct 2026 · Kartik Tandon, Alessio Borgi, Pavel Snopov, Inés García-Redondo, Davide D'Asce…
- Self-Supervised Collapse Prevention with Score-Based Entropy MaximizationPapers · 8 Nov 2026 · Adarsh Kappiyath, Silpa Vadakkeeveetil Sreelatha, Xiatian Zhu, Yann LeCun, Lu Yi…
- The Sense Paradigm for World ModelsPapers · 15 Nov 2026 · Haidong Hu
- SADL: On the Demand-Supply Geometry of Representation CollapsePapers · 16 Nov 2026 · Junhan Sun, Yigui Feng, Mingzhe Liu, Haoyan Xu, Lei Ye, Ziqi Han, Hanru Bai, Yan…
Latest sources
- SADL: On the Demand-Supply Geometry of Representation CollapsePapers · 16 Nov 2026 · Junhan Sun, Yigui Feng, Mingzhe Liu, Haoyan Xu, Lei Ye, Ziqi Han, Hanru Bai, Yan…
- The Sense Paradigm for World ModelsPapers · 15 Nov 2026 · Haidong Hu
- Self-Supervised Collapse Prevention with Score-Based Entropy MaximizationPapers · 8 Nov 2026 · Adarsh Kappiyath, Silpa Vadakkeeveetil Sreelatha, Xiatian Zhu, Yann LeCun, Lu Yi…
- LocaLeJEPA: Maximum Entropy Representations under Geometric PriorsPapers · 20 Oct 2026 · Kartik Tandon, Alessio Borgi, Pavel Snopov, Inés García-Redondo, Davide D'Asce…
- Representations Have Trajectories: Characterizing Temporal Representation Dynamics in Neural NetworksPapers · 17 Oct 2026 · Shivaprasad B. Gowda, Sparsh Mittal