method · first seen 5 Oct 2026
LLM evaluation
Also: LLM evals, language model evaluation, large language model evaluation
Systematically measuring language model outputs against benchmarks or criteria to track quality and regressions.
Mentions per week
PapersCodeDiscussion
Earliest sources
- gwendolynashe/llm-evaluation-workbenchCode · 5 Oct 2026 · gwendolynashe · 35 stars
- HouseholdBench: Evaluating Large Language Models as Predictors of Household Economic BehaviorPapers · 6 Oct 2026 · Jin Huang, Diego Ferreras Garrucho, Yutong Xie, Walter M. Yuan, Qiaozhu Mei, Che…
- Validity Without Ground Truth: What Stated-Preference Economics Offers the Evaluation of Language ModelsPapers · 7 Oct 2026 · Daniel Robert Kling Alexander, Catherine Louise Kling
- SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis ModelsPapers · 20 Oct 2026 · Berke Arda, Peng Cui, Qiaoyuan Zheng, Rudolf Debelak, Mubashara Akhtar, Mrinmaya…
- Show HN: Interactive notes on RLHF, attention, LoRA and LLM evalsDiscussion · 3 Nov 2026 · laxmena · 41 points
Latest sources
- Show HN: Interactive notes on RLHF, attention, LoRA and LLM evalsDiscussion · 3 Nov 2026 · laxmena · 41 points
- SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis ModelsPapers · 20 Oct 2026 · Berke Arda, Peng Cui, Qiaoyuan Zheng, Rudolf Debelak, Mubashara Akhtar, Mrinmaya…
- Validity Without Ground Truth: What Stated-Preference Economics Offers the Evaluation of Language ModelsPapers · 7 Oct 2026 · Daniel Robert Kling Alexander, Catherine Louise Kling
- HouseholdBench: Evaluating Large Language Models as Predictors of Household Economic BehaviorPapers · 6 Oct 2026 · Jin Huang, Diego Ferreras Garrucho, Yutong Xie, Walter M. Yuan, Qiaozhu Mei, Che…
- gwendolynashe/llm-evaluation-workbenchCode · 5 Oct 2026 · gwendolynashe · 35 stars