Early-Signal Detector

phenomenon · first seen 17 Oct 2026

representation collapse

Also: representation collapse prevention

Loss of rank or diversity in neural network representations during training, reducing effective capacity.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

joint-embedding predictive architecturelow-rank simplicity biasself-supervised learningscore matchinglatent world model