method · first seen 4 Oct 2026
model-parallel training
Distributing a neural network across devices by splitting its layers or blocks so they train concurrently.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Greedy Local Learning for Language Model Pretraining: Gaps and Objective DesignPapers · 4 Oct 2026 · Jihwan Moon, Sheir A. Zaheer, Jinmyoung Lee, Gunhee Kim, Chan Y. Park
Latest sources
- Greedy Local Learning for Language Model Pretraining: Gaps and Objective DesignPapers · 4 Oct 2026 · Jihwan Moon, Sheir A. Zaheer, Jinmyoung Lee, Gunhee Kim, Chan Y. Park