method · first seen 19 Oct 2026
automatic parallelism
Also: auto-parallelism, automatic parallelization, automatic parallelization for model training
Automatically selecting device assignment, layer partitioning, and pipeline configuration for distributed model training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- GeoTrain: Energy-Aware Automatic Parallelism for Foundation Model Training on Heterogeneous Geo-Distributed ResourcesPapers · 19 Oct 2026 · Bui-Khanh Hoang, TianZhang He, Mohammad Goudarzi
- MemX: Memory-Aware Automatic Parallelism for Cross-Vendor Heterogeneous GPU TrainingPapers · 30 Oct 2026 · Lin Meng, Yuzhong Sun, Jie Zhu
- AutoParallel: Composable, PyTorch-Native Automatic Parallelism for Production TrainingPapers · 5 Nov 2026 · Kaijian Wang, Sanket Purandare, Aditya Venkataraman, Will Constable, Ivan Kobzar…
Latest sources
- AutoParallel: Composable, PyTorch-Native Automatic Parallelism for Production TrainingPapers · 5 Nov 2026 · Kaijian Wang, Sanket Purandare, Aditya Venkataraman, Will Constable, Ivan Kobzar…
- MemX: Memory-Aware Automatic Parallelism for Cross-Vendor Heterogeneous GPU TrainingPapers · 30 Oct 2026 · Lin Meng, Yuzhong Sun, Jie Zhu
- GeoTrain: Energy-Aware Automatic Parallelism for Foundation Model Training on Heterogeneous Geo-Distributed ResourcesPapers · 19 Oct 2026 · Bui-Khanh Hoang, TianZhang He, Mohammad Goudarzi