phenomenon · first seen 4 Nov 2026
KV cache memory safety
Memory safety bugs such as use-after-free and out-of-bounds access arising in KV cache management during LLM serving.
Mentions per week
PapersCodeDiscussion
Earliest sources
- KVGuard: A KV Cache Safety Checker for LLM Serving SystemsPapers · 4 Nov 2026 · Jonguk Cheong, Myungbin Hwang, Eulgyu Kim, Byoungyoung Lee
Latest sources
- KVGuard: A KV Cache Safety Checker for LLM Serving SystemsPapers · 4 Nov 2026 · Jonguk Cheong, Myungbin Hwang, Eulgyu Kim, Byoungyoung Lee