Early-Signal Detector

method · first seen 6 Oct 2026

logarithmic attention scaling

Also: log n scaled attention

Attention modification that scales logits by log of sequence length to keep attention focused on longer inputs.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

length generalization