Early-Signal Detector

method · first seen 1 Nov 2026

attention scaling for resolution extrapolation

Also: log-ratio attention rescaling, resolution-dependent attention temperature

Training-free rescaling of attention scores by a log ratio of token counts so softmax attention stays focused at higher resolutions.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

register tokensvision transformer