method · first seen 4 Oct 2026
low-rank approximation
Also: TSVD, truncated SVD, low-rank structure, latent factorization, low-rank compression, low-rank decomposition, low-rank factorization
Compressing weight matrices or convolution kernels by approximating them with products of lower-rank factors.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The Functional Structure of Post-Compression Recovery in Low-Rank LLMsPapers · 4 Oct 2026 · Zishan Shao, Liang Tian, Georgiy Zemlevskiy, Kangning Cui, Lixun Zhang, Yixiao W…
- LRCC: Generalizing Low-Rank Compression with Conditional ComputationPapers · 5 Oct 2026 · Thomas Vaitses Fontanari, Maximo Eduardo Rulli, Federico Alvetreti, Donatella Ge…
- Shared Low-rank Basis Factorization for Data-free Mixture-of-Experts CompressionPapers · 7 Oct 2026 · Tianxiao Cao, Jiahe Shao, Yuning Qiu, Kyohei Atarashi, Hisashi Kashima, Qibin Zh…
- D-SLR: The Disjoint Row-Sparse plus Low-Rank DecompositionPapers · 7 Oct 2026 · Vincent Szolnoky
- Spectral Weight Decay: Inducing Low-Rank Structure in Neural Network WeightsPapers · 8 Oct 2026 · Dmitrii Andriianov, Andrey Veprikov, Aleksandr Beznosikov
- Sub-1-Bit LLM Compression via Latent FactorizationDiscussion · 8 Oct 2026 · brainless · 90 points
Latest sources
- Blind Noise Equalization for Large Data Matrices under General Variance ProfilesPapers · 5 Nov 2026 · Boris Landa, Francesco Strino, Fabio Parisi, Ruiqi Li, Yuval Kluger
- LowRAM: Low-Rank Keys and Amortised Values for Composable KV Cache Compression at Test-TimePapers · 4 Nov 2026 · Teresa Delgado, Hugo Hazard, Martin Benfeghoul, Jun Wang, Zafeirios Fountas
- ReelCache: An Efficient KV Cache Compression and Management System for Multi-Round Video GenerationPapers · 31 Oct 2026 · Tianyu Wang, Daiyang Yu, Zhiwei Ren, Junbo Li, Jitian Zhang, Longfei Shangguan
- LoRA on a Budget: Function-Aware Post-Hoc Compression for Adapter FleetsPapers · 26 Oct 2026 · Shenghui Li, Thiemo Voigt
- GS-MoE: Training-Free MoE Compression via Groupwise Subspace Sharing and PruningPapers · 23 Oct 2026 · Carson Cary, Yukai Jin, Yihao Huang, Zhankai Ye, Fangyi Li, Ting Hua, Xin Liu, S…
- Training-free Acceleration for Blind Compressed Image Restoration via Activation-Calibrated Singular Value DecompositionPapers · 21 Oct 2026 · Suhang Yao, Xin Li, Xijun Wang, Yufei Wang, Yeying Jin, Zhibo Chen
- A KAN-based Non-linear Factorization for Embedding Layer CompressionPapers · 21 Oct 2026 · Oliver Giudice, Anna Russo Russo
- WUSPruner: Second-Moment-Optimal Transforms for Structured PruningPapers · 11 Oct 2026 · Shengkun Tang, Dan Alistarh, Zhiqiang Shen
- LightVAE: Towards Compact and Efficient Video AutoencodersPapers · 10 Oct 2026 · Shiqiao Gu, Yang Yong, Fengjun Zhong, Ruihao Gong, Chengtao Lv, Xiangyu Fan, Lei…
- Sub-1-Bit LLM Compression via Latent FactorizationDiscussion · 8 Oct 2026 · brainless · 90 points
- Spectral Weight Decay: Inducing Low-Rank Structure in Neural Network WeightsPapers · 8 Oct 2026 · Dmitrii Andriianov, Andrey Veprikov, Aleksandr Beznosikov
- D-SLR: The Disjoint Row-Sparse plus Low-Rank DecompositionPapers · 7 Oct 2026 · Vincent Szolnoky