trends.barnas.net

phenomenon · first seen 23 Oct 2026

retrieval heads

Attention heads specialized for locating and copying relevant tokens from long contexts.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

multi-head self-attentionlong-context language modelingmultimodal large language model physics reasoninglistwise reranking