method · first seen 13 Oct 2026
sparse attention masks
Attention patterns restricting which query-key pairs are computed, such as sliding-window or block-sparse masks.
Mentions per week
PapersCodeDiscussion
Earliest sources
- FlashMask-3: Efficient and Expressive Mask-Aware Distributed AttentionPapers · 13 Oct 2026 · Guoxia Wang, Qianyue He, Siming Wu, Haoyang Xie, Qiwen Bao, Jinle Zeng, Jiabin Y…
Latest sources
- FlashMask-3: Efficient and Expressive Mask-Aware Distributed AttentionPapers · 13 Oct 2026 · Guoxia Wang, Qianyue He, Siming Wu, Haoyang Xie, Qiwen Bao, Jinle Zeng, Jiabin Y…