Early-Signal Detector

phenomenon · first seen 4 Oct 2026

attention sink

Transformer attention heads concentrating large attention mass on a few early or uninformative tokens.

Mentions per week

0419 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

vision-language modelsoftpick attentionstop-gradient normalizationspectral analysis of attentionhallucination mitigationregister tokensgraph transformervisual groundingstreaming video object removalfaithfulness hallucination detection