method · first seen 8 Oct 2026
data mixture scaling laws
Also: data mixing, data mixture, data mixture optimization
Empirical laws predicting model performance as a function of the proportions and amounts of different training data sources.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Conditional Transfer from Controlled Pretraining Mixtures to CodePapers · 8 Oct 2026 · Ohad Rubin
- Scaling Laws for Multimodal Data MixturesPapers · 10 Oct 2026 · Aditi Khandelwal, Ayush K. Tarun, Yixuan Xu, Imanol Schlag, Golnoosh Farnadi, Si…
- Beyond Data Schedule: Fast LLM Pretraining on Data Mixtures by Loss-ReweightingPapers · 23 Oct 2026 · Jiazheng Li, Huaqing Zhang, Jing Xu, Tianle Cai, Jingzhao Zhang
- Advancement or Acceleration? How Data Curation Improves LLM TrainingPapers · 27 Oct 2026 · Jiaxing Wang, Zicheng Zhang, Deping Xiang, Jin Xu, Yong Li, Chao Liu, Pengzhang…
- LinMix: Data Mixing as Linear Domain AttributionPapers · 27 Oct 2026 · Hubert Baniecki, Przemyslaw Biecek, Martin Pawelczyk
Latest sources
- LinMix: Data Mixing as Linear Domain AttributionPapers · 27 Oct 2026 · Hubert Baniecki, Przemyslaw Biecek, Martin Pawelczyk
- Advancement or Acceleration? How Data Curation Improves LLM TrainingPapers · 27 Oct 2026 · Jiaxing Wang, Zicheng Zhang, Deping Xiang, Jin Xu, Yong Li, Chao Liu, Pengzhang…
- Beyond Data Schedule: Fast LLM Pretraining on Data Mixtures by Loss-ReweightingPapers · 23 Oct 2026 · Jiazheng Li, Huaqing Zhang, Jing Xu, Tianle Cai, Jingzhao Zhang
- Scaling Laws for Multimodal Data MixturesPapers · 10 Oct 2026 · Aditi Khandelwal, Ayush K. Tarun, Yixuan Xu, Imanol Schlag, Golnoosh Farnadi, Si…
- Conditional Transfer from Controlled Pretraining Mixtures to CodePapers · 8 Oct 2026 · Ohad Rubin