trends.barnas.net

phenomenon · first seen 9 Nov 2026

attention head specialization

Emergence of distinct, interpretable roles among attention heads in transformer models.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

DINO