method · first seen 31 Oct 2026
semantic caching
Caching LLM responses by matching semantically similar queries rather than exact text.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Multi-Turn Semantic Caching for Low-Cost LLM ServingPapers · 31 Oct 2026 · Baran Atalar, Selly Beyene, Xutong Liu, Carlee Joe-Wong
- Nightdalefaun/resocket-mod-llm-chatterCode · 31 Oct 2026 · Nightdalefaun · 28 stars
- Semantic Caches for LLM Web Services Leave Their Error Budget UnspentPapers · 2 Nov 2026 · Hanshuai Cui, Qianli Ma, Zhiqing Tang
- Beyond Query Similarity: Safety-Conditioned Cache Routing for LLM Response ReusePapers · 7 Nov 2026 · Shilong Pan, Zhiliang Tian, Weiguo Chen, Zihan Chen, DongSheng Li
- yanstd888/9routerxCode · 7 Nov 2026 · yanstd888 · 248 stars
Latest sources
- yanstd888/9routerxCode · 7 Nov 2026 · yanstd888 · 248 stars
- Beyond Query Similarity: Safety-Conditioned Cache Routing for LLM Response ReusePapers · 7 Nov 2026 · Shilong Pan, Zhiliang Tian, Weiguo Chen, Zihan Chen, DongSheng Li
- Semantic Caches for LLM Web Services Leave Their Error Budget UnspentPapers · 2 Nov 2026 · Hanshuai Cui, Qianli Ma, Zhiqing Tang
- Nightdalefaun/resocket-mod-llm-chatterCode · 31 Oct 2026 · Nightdalefaun · 28 stars
- Multi-Turn Semantic Caching for Low-Cost LLM ServingPapers · 31 Oct 2026 · Baran Atalar, Selly Beyene, Xutong Liu, Carlee Joe-Wong