method · first seen 23 Oct 2026
loss reweighting
Adjusting per-domain loss scales during training to change how strongly each data domain contributes without altering data exposure.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Beyond Data Schedule: Fast LLM Pretraining on Data Mixtures by Loss-ReweightingPapers · 23 Oct 2026 · Jiazheng Li, Huaqing Zhang, Jing Xu, Tianle Cai, Jingzhao Zhang
Latest sources
- Beyond Data Schedule: Fast LLM Pretraining on Data Mixtures by Loss-ReweightingPapers · 23 Oct 2026 · Jiazheng Li, Huaqing Zhang, Jing Xu, Tianle Cai, Jingzhao Zhang