method · first seen 5 Oct 2026
low-rank gradient projection
Also: LoGRA
Compressing gradients into low-rank sketches to reduce memory use during training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient SketchesPapers · 5 Oct 2026 · Shaokun Zhang, Yifan Zhang, Jian Hu, Yueying Li, Hao Zhang, Binfeng Xu, Jan Kaut…
- ResQAdam: Residual-Preserving Adaptive Optimization for Memory-Efficient Quantization Aware TrainingPapers · 6 Nov 2026 · Liqun Ma, Shengkun Tang, Liangyu Wang, Lin Zhao, Wei Luo, Xinjun Niu, Spandan Ti…
Latest sources
- ResQAdam: Residual-Preserving Adaptive Optimization for Memory-Efficient Quantization Aware TrainingPapers · 6 Nov 2026 · Liqun Ma, Shengkun Tang, Liangyu Wang, Lin Zhao, Wei Luo, Xinjun Niu, Spandan Ti…
- LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient SketchesPapers · 5 Oct 2026 · Shaokun Zhang, Yifan Zhang, Jian Hu, Yueying Li, Hao Zhang, Binfeng Xu, Jan Kaut…