benchmark · first seen 6 Oct 2026
multilingual benchmark
Evaluation suites that test language models across multiple languages, often including native or translated data.
Mentions per week
PapersCodeDiscussion
Earliest sources
- sk-bench: A Native-First Benchmark for Evaluating Large Language Models in SlovakPapers · 6 Oct 2026 · Marek Šuppa, Ivan Vykopal, Andrej Ridzik, Kristián Sopkovič, Natália Kňaže…
- Scaling Synthetic Pre-training Data and Evaluation for Indic LLMsPapers · 19 Oct 2026 · Abhinav Khattar, Aishwarya Chhabra, Ameya Velingker, Anusha Kamath, Brandon Nori…
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsPapers · 19 Oct 2026 · Ocean Monjur, Daud Ahmad Nisar, Shahriar Kabir Nahin, Tadesse Destaw Belay, Sush…
- The State and Fate of Multilingual, Contextual Evaluation in the NLP WorldPapers · 27 Oct 2026 · Manan Uppadhyay, Himanshu Beniwal, Prashant Kodali, Sunayana Sitaram
- Benchmarking Multilingual Document Understanding in Vision-Language ModelsPapers · 10 Nov 2026 · Matteo Gabburo, Daniela Baiamonte, Stefano Simonazzi, Silvia Gardini, Sean Cesar…
Latest sources
- Benchmarking Multilingual Document Understanding in Vision-Language ModelsPapers · 10 Nov 2026 · Matteo Gabburo, Daniela Baiamonte, Stefano Simonazzi, Silvia Gardini, Sean Cesar…
- The State and Fate of Multilingual, Contextual Evaluation in the NLP WorldPapers · 27 Oct 2026 · Manan Uppadhyay, Himanshu Beniwal, Prashant Kodali, Sunayana Sitaram
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsPapers · 19 Oct 2026 · Ocean Monjur, Daud Ahmad Nisar, Shahriar Kabir Nahin, Tadesse Destaw Belay, Sush…
- Scaling Synthetic Pre-training Data and Evaluation for Indic LLMsPapers · 19 Oct 2026 · Abhinav Khattar, Aishwarya Chhabra, Ameya Velingker, Anusha Kamath, Brandon Nori…
- sk-bench: A Native-First Benchmark for Evaluating Large Language Models in SlovakPapers · 6 Oct 2026 · Marek Šuppa, Ivan Vykopal, Andrej Ridzik, Kristián Sopkovič, Natália Kňaže…