method · first seen 5 Oct 2026
tensor resharding
Redistributing model tensors across devices when training and inference use different parallel layouts.
Mentions per week
PapersCodeDiscussion
Earliest sources
- NCCL M2N: A Layout- and Topology-Aware Collective for Distributed Tensor ReshardingPapers · 5 Oct 2026 · Kaushik Kandadi, Youngeun Kwon, Sreeram Potluri, Ching-Hsiang Chu, Ke Wen, Pouya…
Latest sources
- NCCL M2N: A Layout- and Topology-Aware Collective for Distributed Tensor ReshardingPapers · 5 Oct 2026 · Kaushik Kandadi, Youngeun Kwon, Sreeram Potluri, Ching-Hsiang Chu, Ke Wen, Pouya…