Early-Signal Detector

method · first seen 18 Oct 2026

communication-computation overlap

Also: tensor parallelism communication overlap

Running communication and computation concurrently to hide data transfer latency in parallel computing.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

NCCL collective communicationpipelined conjugate gradientmixture of expertsin-network collectivesLLM serving systemsring all-reduceexpert parallelismpersistent kernelDiLoCo