method · first seen 8 Oct 2026
rubric-based evaluation
Also: LLM rubrics, rubric trees, binary rubrics, rubric grading, rubric-guided process supervision
Assessing open-ended model outputs using structured criteria and scoring rules rather than single holistic judgments.
Mentions per week
PapersCodeDiscussion
Earliest sources
- DistressBench: Evaluating Multi-Dimensional Crisis Support in Large Language ModelsPapers · 8 Oct 2026 · Drew Rein, Patrick Oathout, Vishal Kumar, Udari Madhushani Sehwag
- From Structure to Validity: Mechanism-Guided Generation and Refinement of LLM RubricsPapers · 9 Oct 2026 · Feifei Qian, Xuan Chen, Lixin Cui, Chaoyang Mei, Fanlin Meng, Shuyao Xiao, Ming…
- LifeSearch: Benchmarking Deep Research Agents for Real-World Life and ProductivityPapers · 13 Oct 2026 · Yibo Wang, Senjie Jin, Yansong Ning, Xinbing Liang, Haotian Luo, Jiazheng Zhang,…
- Not All Criteria Matter: Importance-Aware Criteria Weighting for Rubric-Based LLM EvaluationPapers · 14 Oct 2026 · Haocheng Yang, Licheng Pan, Yiming Dong, Xiaoxi Li, Yuan Lu, Zhenhao Chen, Jiaju…
- SoK: Grading Open-Text Legal Answers, from Law School Exams to Trustworthy Rubric JudgesPapers · 14 Oct 2026 · Sebastian Nagl
- BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World ReferencesPapers · 14 Oct 2026 · Xinyu Fang, Yuchi Wang, Weihao Yu, Rongyao Fang, Zhaohai Li, Zhixun Li, Tianchen…
Latest sources
- Personalized Memory Rubrics: Learning What to Remember per User via Rubric-Guided Credit AssignmentPapers · 10 Nov 2026 · Yupeng Han, Kai Zhang, Shuochen Liu, Ze Liu, Xianquan Wang, Zhihong Pan, Xiangyu…
- CARTBench: Rubric-Based Evaluation of Shopping Advice for Complex and Ambiguous Requests with TimelinesPapers · 4 Nov 2026 · Yuqin Dai, Zhanwei Zhang, Honghui Yang, Zhouheng Yao, Yueqi Zhang, Jingyu He, Ch…
- AgenticFinBench: Benchmarking Financial Agents on Diverse Tasks from Real-World RequestsPapers · 3 Nov 2026 · Shu Zhou, Ziyang He, Yuxin Rao, Yudong Fang, Jiali Qian, Dongyuan Chen, Juntao Z…
- RubricAtlas: Mining Type-Level Rubrics from Expert Reports to Evaluate Deep Research AgentsPapers · 27 Oct 2026 · Delin Wang, Sinuo Wang, Rui Sun, Beidi Luan, Qiming Shi, Jing Li, Daxin Jiang, Z…
- When the Critic Falls Behind: Co-Evolving Rubrics and Harnesses for Continual Agent Self-ImprovementPapers · 27 Oct 2026 · Hao Chen, Yukun Yan, Ziyu Han, Ye He, Chuanzhe Guo, Shangzhan Li, Qi Shi, Qingfu…
- Patient-specific rubric-based evaluation of large language models across longitudinal cancer carePapers · 26 Oct 2026 · Wei-Wei Zhang, Pengkai Wang, Yan Li, Zhijie Sang, Guan-Qun Zhou, Jun-Yan Li, Shu…
- AdaPRA: Process Reward Agents with Adaptive Rubrics for Data SciencePapers · 23 Oct 2026 · Atharva Naik, Vivek Chari, Pol Llado, Daniel Fried, Carolyn Rosé, Benjamin Van…
- Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research ReportsPapers · 22 Oct 2026 · Jiahao Meng, Qize Yang, Yuxuan Wang, Yunfei Chu, Wensi Dai, Jin Xu, Yunhai Tong
- RubricCraft: Where Solutions Diverge, Criteria EmergePapers · 21 Oct 2026 · Hosein Hasanbeig, Priyanshu Gupta, Ashish Tiwari, Vu Le, Sumit Gulwani
- MoveBench: A Rubric-Based Benchmark for Evaluating Large Language Models in Sports and Health CoachingPapers · 19 Oct 2026 · Yitong Li, Jiang Bian, Jingling Wang, Pan Ding, Chengying Gu, Xing Huang, Hana S…
- Rubric Judgments Lack Uncertainty: Conformal Weighting for LLM EvaluationPapers · 15 Oct 2026 · Licheng Pan, Haocheng Yang, Haoxuan Li, Yuzhou Chen, Yichen Sun, Yuan Lu, Xiaoxi…
- BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World ReferencesPapers · 14 Oct 2026 · Xinyu Fang, Yuchi Wang, Weihao Yu, Rongyao Fang, Zhaohai Li, Zhixun Li, Tianchen…