trends.barnas.net

method · first seen 5 Nov 2026

learnable gating for attention

Adding trainable gates to attention weights inside the softmax to decide which cached entries to keep.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

KV cache eviction