method · first seen 9 Oct 2026
sliding window attention
Also: sliding window KV cache
Attention restricted to a fixed-size local window of tokens around each position.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Orthros: Phase-Aware Heterogeneous Attention for Efficient TransformersPapers · 9 Oct 2026 · Yuhong Chou, Zehao Liu, Yuqi Pan, Qian Liu, Xianwei Chen, Zhongzhu Zhou, Jibin W…
- Why Full-Duplex Speech Models Collapse in Long ConversationsPapers · 23 Oct 2026 · Yeonju Kim, Bella Godiva, Se Jin Park, Yong Man Ro
- Context Compaction for World ModelsPapers · 28 Oct 2026 · Hayder Tirmazi
- Unlimited OCR Works 2Papers · 29 Oct 2026 · Shu Wei, Jingjing Wu, Qunyi Xie, Lingshu Zhang, Xiangcheng Du, Yannian Fu, Mengj…
- Gabor Gabor: E-Gaborformer, a Strictly Causal Speech Recognizer with Gabor-Dictionary Convolutions and Delta-Rule MemoryPapers · 5 Nov 2026 · Nir Krakowski, Tamir Cohen, Ohad Zohar, Chen Zarfati
Latest sources
- Gabor Gabor: E-Gaborformer, a Strictly Causal Speech Recognizer with Gabor-Dictionary Convolutions and Delta-Rule MemoryPapers · 5 Nov 2026 · Nir Krakowski, Tamir Cohen, Ohad Zohar, Chen Zarfati
- Unlimited OCR Works 2Papers · 29 Oct 2026 · Shu Wei, Jingjing Wu, Qunyi Xie, Lingshu Zhang, Xiangcheng Du, Yannian Fu, Mengj…
- Context Compaction for World ModelsPapers · 28 Oct 2026 · Hayder Tirmazi
- Why Full-Duplex Speech Models Collapse in Long ConversationsPapers · 23 Oct 2026 · Yeonju Kim, Bella Godiva, Se Jin Park, Yong Man Ro
- Orthros: Phase-Aware Heterogeneous Attention for Efficient TransformersPapers · 9 Oct 2026 · Yuhong Chou, Zehao Liu, Yuqi Pan, Qian Liu, Xianwei Chen, Zhongzhu Zhou, Jibin W…