method · first seen 1 Nov 2026
attention-based token scoring
Ranking tokens by the attention they receive from queries to decide which tokens to retain.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Who Should Score the Cache? Mid-Depth Layers Are the Best Judges of KV-Cache EvictionPapers · 1 Nov 2026 · Ekaterina Seregina
Latest sources
- Who Should Score the Cache? Mid-Depth Layers Are the Best Judges of KV-Cache EvictionPapers · 1 Nov 2026 · Ekaterina Seregina