phenomenon · first seen 8 Nov 2026
option exploitation
Models achieving high multiple-choice scores through language priors and answer options without genuine visual perception.
Mentions per week
PapersCodeDiscussion
Earliest sources
- What Does Multiple Choice Actually Measure? Disentangling Video Understanding from Option ExploitationPapers · 8 Nov 2026 · Elliott Piercy, Justin Chan, Sepand Dyanatkar
Latest sources
- What Does Multiple Choice Actually Measure? Disentangling Video Understanding from Option ExploitationPapers · 8 Nov 2026 · Elliott Piercy, Justin Chan, Sepand Dyanatkar