method · first seen 18 Oct 2026
communication-computation overlap
Also: tensor parallelism communication overlap
Running communication and computation concurrently to hide data transfer latency in parallel computing.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Triple Overlap in Pipelined Krylov Methods on Multi-GPU SystemsPapers · 18 Oct 2026 · Sinan Ekmekçibaşı, James D. Trotter, Johannes Langguth, Xing Cai, Didem Unat
- INC-MoE: Overlapping In-Network Collectives and Expert Computation for Expert-Parallel Mixture-of-Experts InferencePapers · 26 Oct 2026 · John Stephan, Razvan Puscasu, Xu Yong, Ding Jiutao, Guan Zixuan
- Introducing Cluster Efficiency to LLM Serving: Pooling Economical Accelerators over Fast InterconnectsPapers · 2 Nov 2026 · Youhe Jiang, Pavle Glušac, Binhang Yuan, Eiko Yoneki
- KOSMOS: Self-scheduling Persistent Kernels for Communication-Compute OverlapPapers · 5 Nov 2026 · Alexander Magro, Aristotle Martin, Ye Wang, Wen Chen
- LACCO: Local Accumulation with Computation--Communication OverlapPapers · 13 Nov 2026 · Daniele Kopyshevskiy, Benjamin Th{é}rien, Nicolas Pinto, Edouard Oyallon
Latest sources
- LACCO: Local Accumulation with Computation--Communication OverlapPapers · 13 Nov 2026 · Daniele Kopyshevskiy, Benjamin Th{é}rien, Nicolas Pinto, Edouard Oyallon
- KOSMOS: Self-scheduling Persistent Kernels for Communication-Compute OverlapPapers · 5 Nov 2026 · Alexander Magro, Aristotle Martin, Ye Wang, Wen Chen
- Introducing Cluster Efficiency to LLM Serving: Pooling Economical Accelerators over Fast InterconnectsPapers · 2 Nov 2026 · Youhe Jiang, Pavle Glušac, Binhang Yuan, Eiko Yoneki
- INC-MoE: Overlapping In-Network Collectives and Expert Computation for Expert-Parallel Mixture-of-Experts InferencePapers · 26 Oct 2026 · John Stephan, Razvan Puscasu, Xu Yong, Ding Jiutao, Guan Zixuan
- Triple Overlap in Pipelined Krylov Methods on Multi-GPU SystemsPapers · 18 Oct 2026 · Sinan Ekmekçibaşı, James D. Trotter, Johannes Langguth, Xing Cai, Didem Unat