method · first seen 3 Nov 2026
communication compression for model-parallel training
Reducing data transferred between devices during distributed model-parallel training via lossy compression.
Mentions per week
PapersCodeDiscussion
Earliest sources
- FP4Quant: Efficient 4-Bit Communication Compression for Model-Parallel LLM TrainingPapers · 3 Nov 2026 · Man Liu, Xingchen Liu, Hairui Zhao, Guangming Tan, Dingwen Tao
Latest sources
- FP4Quant: Efficient 4-Bit Communication Compression for Model-Parallel LLM TrainingPapers · 3 Nov 2026 · Man Liu, Xingchen Liu, Hairui Zhao, Guangming Tan, Dingwen Tao