benchmark · first seen 6 Oct 2026
multimodal large language model evaluation
Also: MLLM benchmark, MLLM evaluation, MLLM benchmarking, multimodal large language model benchmark
Benchmarks that test multimodal language models on perception, reasoning, and understanding tasks over images and video.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal ModelsPapers · 6 Oct 2026 · Xingang Guo, Jing Gu, Brian Jang, Renxiong Wang, Utkarsh Tyagi, Daniel Quigley,…
- HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual ReasoningPapers · 10 Oct 2026 · Yiming Zhang, Enzhi Zhou, Junan Lin, Dulan Zhou, Weiqiang Wang, Yuge Huang, Jian…
- The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video UnderstandingPapers · 13 Oct 2026 · Georgios Angelidis, Aggelos Psiris, Maria Vakalopoulou, Georgios Th. Papadopoulo…
- Seeing is Believing: Benchmarking and Mitigating the Interference of Language Priors on Visual Perception in MLLMsPapers · 15 Oct 2026 · Li Ma, Yan Zhuang, Jiawen Deng, Fuji Ren
- AdShot: Benchmarking Multimodal Large Language Models for Video Advertisement ClippingPapers · 24 Oct 2026 · Wen Xie, Om Rastogi, Sai Siddhartha Vivek Dhir Rangoju, Gijs Overgoor, Yakov Bar…
- What do MLLMs know about 'Waldo'? Evaluating Visual Reasoning under Multi-Instance Multi-Object ChallengesPapers · 28 Oct 2026 · Saumya Mundra, Ajoy Mondal, Vineeth N Balasubramanian, C. V. Jawahar
Latest sources
- RAMP: Rethinking Multimodal Evaluation through Answer Readout ProtocolsPapers · 16 Nov 2026 · Jianye Zeng, Qiao Yikang, Duan Huang, Ziying Song
- XLSAR-Bench: Towards Extremely Large SAR Imagery Understanding of MLLMsPapers · 14 Nov 2026 · La Jiang, Lingfeng Chen, Jiaqi Zhu, Fengrong Guo, Jiehua Zhang, Panhe Hu, Li Liu…
- HumanSightBench: A Benchmark for Human Visual Perception in MLLMsPapers · 9 Nov 2026 · Zixin Su, Yangguang Lin, Zegang Peng, Yuntong Sun, Xuanyi Wang, Jiahao Wang, Qia…
- What do MLLMs know about 'Waldo'? Evaluating Visual Reasoning under Multi-Instance Multi-Object ChallengesPapers · 28 Oct 2026 · Saumya Mundra, Ajoy Mondal, Vineeth N Balasubramanian, C. V. Jawahar
- AdShot: Benchmarking Multimodal Large Language Models for Video Advertisement ClippingPapers · 24 Oct 2026 · Wen Xie, Om Rastogi, Sai Siddhartha Vivek Dhir Rangoju, Gijs Overgoor, Yakov Bar…
- Seeing is Believing: Benchmarking and Mitigating the Interference of Language Priors on Visual Perception in MLLMsPapers · 15 Oct 2026 · Li Ma, Yan Zhuang, Jiawen Deng, Fuji Ren
- The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video UnderstandingPapers · 13 Oct 2026 · Georgios Angelidis, Aggelos Psiris, Maria Vakalopoulou, Georgios Th. Papadopoulo…
- HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual ReasoningPapers · 10 Oct 2026 · Yiming Zhang, Enzhi Zhou, Junan Lin, Dulan Zhou, Weiqiang Wang, Yuge Huang, Jian…
- Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal ModelsPapers · 6 Oct 2026 · Xingang Guo, Jing Gu, Brian Jang, Renxiong Wang, Utkarsh Tyagi, Daniel Quigley,…