task · first seen 13 Oct 2026
distributed training
Training large models across many GPUs or nodes with parallelism strategies.
Mentions per week
PapersCodeDiscussion
Earliest sources
- A Distributed View from a Single GPU: RankLens for Distributed TrainingPapers · 13 Oct 2026 · Yufan Wang, Yihao Zhang, Yi Liu
- MCCL: Training Pytorch models across a fleet of Macs at Skywalker SoundPapers · 28 Oct 2026 · Kevin Sasso, Chris Fiegel, Francis Aitken, Nicolas Tsingos, Nicholas Tong
Latest sources
- MCCL: Training Pytorch models across a fleet of Macs at Skywalker SoundPapers · 28 Oct 2026 · Kevin Sasso, Chris Fiegel, Francis Aitken, Nicolas Tsingos, Nicholas Tong
- A Distributed View from a Single GPU: RankLens for Distributed TrainingPapers · 13 Oct 2026 · Yufan Wang, Yihao Zhang, Yi Liu