Early-Signal Detector

method · first seen 7 Oct 2026

KV cache offloading

Also: KV cache offload, KV cache storage, KV cache spilling, host-tier KV cache, KV state persistence, remote KV cache tier, hierarchical KV caching

Saving transformer key-value cache state to disk and reloading it later instead of recomputing it for long prompts.

Mentions per week

0419 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Rank 105 on 16 Nov 2026 · 12 mentions in 28 days · 12 independent groups · papers → code · first seen 6 weeks ago · acceleration -0.34

Earliest sources

Latest sources

Mentioned together with

speculative decodingprefill-decode disaggregationdiscrete-event simulationlatent attentioncontext parallelismlong-context language modelingmulti-token predictionactivation-aware weight quantizationSSD lifetime management for KV cacheKV cache