method · first seen 6 Oct 2026
random Hadamard transform
Also: RHT, randomized Hadamard, randomized Hadamard transform
A randomized orthogonal rotation used to spread out weight outliers before quantization.
Mentions per week
PapersCodeDiscussion
Earliest sources
- CurveTQ: Rotation-Free Trellis Quantization of LLM Weights via Curvature-Weighted SearchPapers · 6 Oct 2026 · Guanhua Ding, Zi Wang, Ruichao Li, Jack Liu
- Fast Quantized Johnson$-$Lindenstrauss TransformsPapers · 12 Oct 2026 · Angelos Korakitis, Vasileios Nakos
- Training an MoE LLM in MXFP4: How We Closed the Gap to BF16Papers · 23 Oct 2026 · Han Wang, Zhitao Wang, Natalia Frumkin, Xuanwu Yin, Alireza Khodamoradi, Dong Li…
Latest sources
- Training an MoE LLM in MXFP4: How We Closed the Gap to BF16Papers · 23 Oct 2026 · Han Wang, Zhitao Wang, Natalia Frumkin, Xuanwu Yin, Alireza Khodamoradi, Dong Li…
- Fast Quantized Johnson$-$Lindenstrauss TransformsPapers · 12 Oct 2026 · Angelos Korakitis, Vasileios Nakos
- CurveTQ: Rotation-Free Trellis Quantization of LLM Weights via Curvature-Weighted SearchPapers · 6 Oct 2026 · Guanhua Ding, Zi Wang, Ruichao Li, Jack Liu