method · first seen 4 Nov 2026
ring attention
Distributed attention that splits a long sequence across devices arranged in a ring to overlap communication with computation.
Mentions per week
PapersCodeDiscussion
Earliest sources
- CHARM+: Cross-Hardware Attention with Re-Merge Multistream MechanismPapers · 4 Nov 2026 · Xinhang Zhang, Boning Zhang, Chengchun Liu, Chunpu Li, Lei Sun, Weifeng Zhang, L…
Latest sources
- CHARM+: Cross-Hardware Attention with Re-Merge Multistream MechanismPapers · 4 Nov 2026 · Xinhang Zhang, Boning Zhang, Chengchun Liu, Chunpu Li, Lei Sun, Weifeng Zhang, L…