method · first seen 5 Nov 2026
low-rank state compression
Storing recurrent states in low-rank form to reduce memory traffic during inference.
Mentions per week
PapersCodeDiscussion
Earliest sources
- SPARE: Fast Linear Attention Decoding with Compact Recurrent StatesPapers · 5 Nov 2026 · Ke Wan, Zaiyi Zheng, Chen Chen
- SinkState: On-the-Fly SVD of Recurrent States for Efficient Hybrid LLM ServingPapers · 10 Nov 2026 · Haolin Jiang, Weihang Li, Zhongzhu Zhou, Jinwen Pan, Santosh Pandey, Hang Liu
Latest sources
- SinkState: On-the-Fly SVD of Recurrent States for Efficient Hybrid LLM ServingPapers · 10 Nov 2026 · Haolin Jiang, Weihang Li, Zhongzhu Zhou, Jinwen Pan, Santosh Pandey, Hang Liu
- SPARE: Fast Linear Attention Decoding with Compact Recurrent StatesPapers · 5 Nov 2026 · Ke Wan, Zaiyi Zheng, Chen Chen