trends.barnas.net

phenomenon · first seen 5 Oct 2026

superposition in neural representations

Also: superposition

Neural networks encoding more features than they have dimensions by storing them as nearly orthogonal directions.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

sparse autoencodernatural gradient descentthreshold gate computationsupervised fine-tuningpervasive capability degradation