method · first seen 5 Nov 2026
learnable gating for attention
Adding trainable gates to attention weights inside the softmax to decide which cached entries to keep.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The Gating Mechanism of KV Cache EvictionPapers · 5 Nov 2026 · Hao Gu, Xintong Yang, Zhiwei Li, Lei Zhu, Jian Yang, Qiyuan Zhu, Dezhi Li, Jingy…
Latest sources
- The Gating Mechanism of KV Cache EvictionPapers · 5 Nov 2026 · Hao Gu, Xintong Yang, Zhiwei Li, Lei Zhu, Jian Yang, Qiyuan Zhu, Dezhi Li, Jingy…