method · first seen 17 Oct 2026
memory-efficient optimizer
Optimizers reducing optimizer-state memory, such as pooled or factored moment estimates, for training large models.
Mentions per week
PapersCodeDiscussion
Earliest sources
- AdamPM: Memory-Efficient LLM Optimization via Moment PoolingPapers · 17 Oct 2026 · Xiaowei Ji, Lishan Xu, Jianing An, Jie Luo, Wenjun Wu, Lei Huang
- ResQAdam: Residual-Preserving Adaptive Optimization for Memory-Efficient Quantization Aware TrainingPapers · 6 Nov 2026 · Liqun Ma, Shengkun Tang, Liangyu Wang, Lin Zhao, Wei Luo, Xinjun Niu, Spandan Ti…
Latest sources
- ResQAdam: Residual-Preserving Adaptive Optimization for Memory-Efficient Quantization Aware TrainingPapers · 6 Nov 2026 · Liqun Ma, Shengkun Tang, Liangyu Wang, Lin Zhao, Wei Luo, Xinjun Niu, Spandan Ti…
- AdamPM: Memory-Efficient LLM Optimization via Moment PoolingPapers · 17 Oct 2026 · Xiaowei Ji, Lishan Xu, Jianing An, Jie Luo, Wenjun Wu, Lei Huang