trends.barnas.net

method · first seen 4 Oct 2026

KV cache eviction

Also: KV eviction, key-value cache eviction

Discarding stored key-value cache entries during decoding to bound memory use in transformer inference.

Mentions per week

0519 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Rank 167 on 16 Nov 2026 · 8 mentions in 28 days · 8 independent groups · papers · first seen 6 weeks ago · acceleration +1.36

Earliest sources

Latest sources

Mentioned together with

KV cache reuseblock diffusion language modelslong-context language modelinghybrid attention-recurrent language modelsGated DeltaNettoken pruningattention-based token scoringlearnable gating for attentionrope data structureprefill-decode disaggregation