method · first seen 13 Oct 2026
DiLoCo
Also: distributed low-communication training
Local-update distributed training method that synchronises model replicas infrequently to reduce communication.
Mentions per week
PapersCodeDiscussion
Earliest sources
- How Inner Optimizers Shape Replica ScalingPapers · 13 Oct 2026 · Eugene Belilovsky, Stefan Horoi, Edouard Oyallon, Benjamin Thérien
- LACCO: Local Accumulation with Computation--Communication OverlapPapers · 13 Nov 2026 · Daniele Kopyshevskiy, Benjamin Th{é}rien, Nicolas Pinto, Edouard Oyallon
Latest sources
- LACCO: Local Accumulation with Computation--Communication OverlapPapers · 13 Nov 2026 · Daniele Kopyshevskiy, Benjamin Th{é}rien, Nicolas Pinto, Edouard Oyallon
- How Inner Optimizers Shape Replica ScalingPapers · 13 Oct 2026 · Eugene Belilovsky, Stefan Horoi, Edouard Oyallon, Benjamin Thérien