method · first seen 4 Oct 2026
rotation-based quantization
Also: Hadamard rotation, rotation quantization, random rotation quantization
Applying orthogonal rotations to activations and weights to reduce quantization error.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Loopy: Low-Bit Quantization Framework for Looped Language ModelsPapers · 4 Oct 2026 · Zeyu Li, Yipu Zhang, Jintao Cheng, Xin Li, Wei Zhnag
- ApexQuant: Data-Free Elastic Quantization by Residual Re-IsotropizationPapers · 6 Oct 2026 · Aksel Fristrup, Sumit Pandey, Ankit Kariryaa
- Dual-QK: Sharp Queries and Flat Keys for Prunable 2-bit KV CachesPapers · 7 Oct 2026 · Sunjoo Whang, Jungjun Oh, Minsung Kim, Dongho Seo, Jisu Shin, Gregory Kielian, H…
- ResidualQuant: KV Cache Quantization for Looped Transformers with 2-Bit ResidualsPapers · 7 Oct 2026 · Heejun Kim, Junyoung Lee, SangLyul Cho, Dongsu Han, Insu Han, Sehoon Kim
- LIRQuant: An Efficient Locally Isolated Rotation Quantization Method for Large Language ModelsPapers · 19 Oct 2026 · Desheng Xu, Hanglin Li, Tianchen Song, Zhiyong Zhao, Kun Zhan
- How Much Does Random Rotation Help GPTQ? Sharp Worst-Case Rate Gaps in the High-Rate RegimePapers · 1 Nov 2026 · Runguo Li
Latest sources
- Enabling Retraining-Free Accurate Inference in Analog Compute in Memory AcceleratorsPapers · 5 Nov 2026 · George Karfakis, Puneet Gupta
- FlagRot: Selective Rotation for Low-Bit KV CachesPapers · 2 Nov 2026 · Kunming Shao, Xijie Huang, Jierun Chen, Jiaqi Shao, Yanli Wang, Jiangnan Yu, Qiw…
- How Much Does Random Rotation Help GPTQ? Sharp Worst-Case Rate Gaps in the High-Rate RegimePapers · 1 Nov 2026 · Runguo Li
- LIRQuant: An Efficient Locally Isolated Rotation Quantization Method for Large Language ModelsPapers · 19 Oct 2026 · Desheng Xu, Hanglin Li, Tianchen Song, Zhiyong Zhao, Kun Zhan
- ResidualQuant: KV Cache Quantization for Looped Transformers with 2-Bit ResidualsPapers · 7 Oct 2026 · Heejun Kim, Junyoung Lee, SangLyul Cho, Dongsu Han, Insu Han, Sehoon Kim
- Dual-QK: Sharp Queries and Flat Keys for Prunable 2-bit KV CachesPapers · 7 Oct 2026 · Sunjoo Whang, Jungjun Oh, Minsung Kim, Dongho Seo, Jisu Shin, Gregory Kielian, H…
- ApexQuant: Data-Free Elastic Quantization by Residual Re-IsotropizationPapers · 6 Oct 2026 · Aksel Fristrup, Sumit Pandey, Ankit Kariryaa
- Loopy: Low-Bit Quantization Framework for Looped Language ModelsPapers · 4 Oct 2026 · Zeyu Li, Yipu Zhang, Jintao Cheng, Xin Li, Wei Zhnag