method · first seen 10 Oct 2026
elastic pretraining
Also: nested sub-network training
Training one weight-shared supernet containing nested sub-networks that can be deployed at different compute budgets.
Mentions per week
PapersCodeDiscussion
Earliest sources
- ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter TransferPapers · 10 Oct 2026 · Can Jin, Yan Kang, Yifan Gong, Chongjian Ge, Mingze Xu, Yuanjun Xiong, Dimitris…
Latest sources
- ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter TransferPapers · 10 Oct 2026 · Can Jin, Yan Kang, Yifan Gong, Chongjian Ge, Mingze Xu, Yuanjun Xiong, Dimitris…