method · first seen 11 Oct 2026
paged attention
Also: PagedAttention, vLLM paged attention
A KV-cache memory management technique that stores attention keys and values in fixed-size blocks.
Mentions per week
PapersCodeDiscussion
Rank 152 on 9 Nov 2026 · 6 mentions in 28 days · 6 independent groups · papers → code · first seen 4 weeks ago · acceleration +0.10
Earliest sources
- Native Dual Pools or Shared Paging? Memory Organization for Concurrent Hybrid LLM ServingPapers · 11 Oct 2026 · Dongwook Kang
- The Cost of Context: Profiling the Energy Footprint of Input Tokens in Large Language ModelsPapers · 14 Oct 2026 · Boris Ruf, Marcin Detyniecki
- priyammaz/tinyserveCode · 20 Oct 2026 · priyammaz · 32 stars
- Folding Attention Biases into Keys Makes Compacted KV Caches Run on Standard KernelsPapers · 27 Oct 2026 · Utkarsh Kanwat
- Rimuru: Unified Memory Management for Modern LLM Serving via Elastic Expert OffloadingPapers · 29 Oct 2026 · Zhiyuan Fang, Dingyang Li, Jianfeng Zhong, Bin Wang, Weixi Zhu, Cunshu Ni, Zicon…
- KVGuard: A KV Cache Safety Checker for LLM Serving SystemsPapers · 4 Nov 2026 · Jonguk Cheong, Myungbin Hwang, Eulgyu Kim, Byoungyoung Lee
Latest sources
- simranjeet97/AI_Engineer_Roadmap_2027Code · 7 Nov 2026 · simranjeet97 · 37 stars
- KVGuard: A KV Cache Safety Checker for LLM Serving SystemsPapers · 4 Nov 2026 · Jonguk Cheong, Myungbin Hwang, Eulgyu Kim, Byoungyoung Lee
- Rimuru: Unified Memory Management for Modern LLM Serving via Elastic Expert OffloadingPapers · 29 Oct 2026 · Zhiyuan Fang, Dingyang Li, Jianfeng Zhong, Bin Wang, Weixi Zhu, Cunshu Ni, Zicon…
- Folding Attention Biases into Keys Makes Compacted KV Caches Run on Standard KernelsPapers · 27 Oct 2026 · Utkarsh Kanwat
- priyammaz/tinyserveCode · 20 Oct 2026 · priyammaz · 32 stars
- The Cost of Context: Profiling the Energy Footprint of Input Tokens in Large Language ModelsPapers · 14 Oct 2026 · Boris Ruf, Marcin Detyniecki
- Native Dual Pools or Shared Paging? Memory Organization for Concurrent Hybrid LLM ServingPapers · 11 Oct 2026 · Dongwook Kang