benchmark · first seen 11 Nov 2026
code reasoning benchmark
Evaluation suites testing whether language models truly understand program semantics and execution behavior.
Mentions per week
PapersCodeDiscussion
Earliest sources
- MLIRBench - A Benchmark and Dataset for Compiler and Hardware-Aware ReasoningPapers · 11 Nov 2026 · Pranava Sai Maganti, Meghasyam Peddireddy, Muzakker Hossain, Kaining Gao, Farhan…
Latest sources
- MLIRBench - A Benchmark and Dataset for Compiler and Hardware-Aware ReasoningPapers · 11 Nov 2026 · Pranava Sai Maganti, Meghasyam Peddireddy, Muzakker Hossain, Kaining Gao, Farhan…