method · first seen 5 Oct 2026
activation recomputation
Also: recomputation, rematerialization, gradient checkpointing, tensor rematerialization, memory-efficient backpropagation
Discarding intermediate activations during the forward pass and recomputing them during backpropagation to save GPU memory.
Mentions per week
PapersCodeDiscussion
Earliest sources
- MOLT: A Fine-Grained GPU Memory Sharing System for LLM Serving with Opportunistic Fine-TuningPapers · 5 Oct 2026 · Jaehoon Yang, Yongbeom Kim, Hojoon Kim, Seung Yul Lee, Jae W. Lee
- SlackSwap: Bandwidth-Aware Activation Swapping and Recomputation for Memory-Efficient DNN TrainingPapers · 9 Oct 2026 · Hui Feng, Xun Zhou, Yuxin Wang
- Peak-Memory Schedules You Can Trust: Exact Realization, Certified Optimality, and the Limits of Recomputation for InferencePapers · 16 Oct 2026 · Ivan Fomin, Ivan Koryabkin, Boris Sheludko
- PlaneZip: Lossless Bit-Plane Compression of Training Activations Offloaded over PCIePapers · 18 Oct 2026 · Zhufan Gu, Qizhe Tang, Yuxin Wang, Xun Zhou, Hui Feng
- Scalable Unrolled Chains for MRI ReconstructionPapers · 24 Oct 2026 · Emiljo Mëhillaj, Ender Konukoglu
- MemX: Memory-Aware Automatic Parallelism for Cross-Vendor Heterogeneous GPU TrainingPapers · 30 Oct 2026 · Lin Meng, Yuzhong Sun, Jie Zhu
Latest sources
- TapeSAC: Automated, Pareto-Optimal Fine-Grained Memory Management for Large Model TrainingPapers · 3 Nov 2026 · Kaihui Ren, Yifan Zhao, Zejian Wang, Yingtong Xiong, Xiaoling Zhou, Daohong Xu,…
- State-Aware Activation Recomputation with Replay Contracts and Selective PreservationPapers · 31 Oct 2026 · Annan Zhang, Shengjie Song, Wenshuai Yao, Lihao Zhang, Tianmiao
- MemX: Memory-Aware Automatic Parallelism for Cross-Vendor Heterogeneous GPU TrainingPapers · 30 Oct 2026 · Lin Meng, Yuzhong Sun, Jie Zhu
- Scalable Unrolled Chains for MRI ReconstructionPapers · 24 Oct 2026 · Emiljo Mëhillaj, Ender Konukoglu
- PlaneZip: Lossless Bit-Plane Compression of Training Activations Offloaded over PCIePapers · 18 Oct 2026 · Zhufan Gu, Qizhe Tang, Yuxin Wang, Xun Zhou, Hui Feng
- Peak-Memory Schedules You Can Trust: Exact Realization, Certified Optimality, and the Limits of Recomputation for InferencePapers · 16 Oct 2026 · Ivan Fomin, Ivan Koryabkin, Boris Sheludko
- SlackSwap: Bandwidth-Aware Activation Swapping and Recomputation for Memory-Efficient DNN TrainingPapers · 9 Oct 2026 · Hui Feng, Xun Zhou, Yuxin Wang
- MOLT: A Fine-Grained GPU Memory Sharing System for LLM Serving with Opportunistic Fine-TuningPapers · 5 Oct 2026 · Jaehoon Yang, Yongbeom Kim, Hojoon Kim, Seung Yul Lee, Jae W. Lee