method · first seen 20 Oct 2026
multilingual pretraining
Pretraining language models on text from many languages to enable cross-lingual transfer.
Mentions per week
PapersCodeDiscussion
Earliest sources
- How to Use Parallel Data for Multilingual PretrainingPapers · 20 Oct 2026 · Zhihong Huang, Yao Lu, Derek F. Wong, Hamid Alinejad-Rokny, Min Yang
Latest sources
- How to Use Parallel Data for Multilingual PretrainingPapers · 20 Oct 2026 · Zhihong Huang, Yao Lu, Derek F. Wong, Hamid Alinejad-Rokny, Min Yang