method · first seen 11 Oct 2026
allreduce
Also: all-reduce
A collective communication operation that combines values from all processes and distributes the result back to every process.
Mentions per week
PapersCodeDiscussion
Earliest sources
- DualColl: Throughput-Optimal Bandwidth-Bound Collective Communications via Fractional Tree PackingPapers · 11 Oct 2026 · Namir Ballan, Reuven Cohen
- SP-Allreduce: Symmetric Tree Schedules for Tori and BeyondPapers · 12 Oct 2026 · Mikhail Cherniavskii, Andrey Kupavskii, Georgy Mironov, Stanislav Moiseev
- flash-comm: Self-Synchronizing Collective Communication for LLM DecodingPapers · 4 Nov 2026 · Carrie Wang, Jack Li, Jason Zhao
Latest sources
- flash-comm: Self-Synchronizing Collective Communication for LLM DecodingPapers · 4 Nov 2026 · Carrie Wang, Jack Li, Jason Zhao
- SP-Allreduce: Symmetric Tree Schedules for Tori and BeyondPapers · 12 Oct 2026 · Mikhail Cherniavskii, Andrey Kupavskii, Georgy Mironov, Stanislav Moiseev
- DualColl: Throughput-Optimal Bandwidth-Bound Collective Communications via Fractional Tree PackingPapers · 11 Oct 2026 · Namir Ballan, Reuven Cohen