trends.barnas.net

method · first seen 22 Oct 2026

window attention

Also: windowed self-attention

Restricting self-attention computation to local groups of tokens to reduce cost.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

hybrid attention-recurrent language modelspoint cloud transformer