method · first seen 8 Oct 2026
item response theory
Also: IRT
A psychometric framework that models how latent abilities interact with item difficulty to produce test responses.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Searching for "Harmful Refusal": A Psychometric Audit of an AI Safety BenchmarkPapers · 8 Oct 2026 · Christopher M. Stewart, Preston Botter, Natalie Sarabosing, Muye Zhang, Rachel P…
- On the estimation and validity of AI time horizons---a statistical look at the METR plotPapers · 8 Oct 2026 · Drew T. Nguyen, William Fithian
- A Unified Response Framework for Questions and Tutoring DialoguesPapers · 14 Oct 2026 · Zhangqi Duan, Simon Woodhead, Maya Miller-Vedam, Andrew Lan
- A Measurement Perspective on Benchmarking LLM-Generated Text Detectors using Item Response TheoryPapers · 18 Oct 2026 · Yanbin Zhao, Zhipeng Chen, Guangsheng Bao, Guandong Zhang, Yan Li
- Prediction Is Not Calibration: Item Parameter Recovery and Representation Coupling in Knowledge TracingPapers · 21 Oct 2026 · Wenrui Yuan, Stéphanie M. van den Berg, Johannes Steinrücke
- Your Benchmark Is an Empirical Measure Over DifficultyPapers · 21 Oct 2026 · Yifan Sun, Naicheng Yu, Jiawen Gong, Jingyan Shen, Huan Zhang
Latest sources
- Can We Make an LLM Dumber, or Is It Just Playing Dumb? An Empirical Study of Believable Performance ThrottlingPapers · 11 Nov 2026 · Chengguang Gan, Yunhao Liang, Hanjun Wei, QingHao Zhang, Shiwen Ni
- FIBER: Bayesian Fusion of Fast-DetectGPT and IRT-Informed Detector Evidence for LLM-Generated Text DetectionPapers · 11 Nov 2026 · Yan Li, Guangsheng Bao, Zhipeng Chen, Guandong Zhang, Yanbin Zhao
- Task-Efficient Agent Evaluation Using Cached TracesPapers · 4 Nov 2026 · Ben Johnson, Hayden Helm
- AGORA: Reliability-Aware Aggregation of LLM Judges on Small Evaluation SetsPapers · 3 Nov 2026 · Junhyung Ahn
- Algorithmic drift in generative adaptive learningPapers · 22 Oct 2026 · Firuz Kamalov, Hana Sulieman, Ahmed El Sayed, Sivaraj R., Nitesh Sughnani
- Your Benchmark Is an Empirical Measure Over DifficultyPapers · 21 Oct 2026 · Yifan Sun, Naicheng Yu, Jiawen Gong, Jingyan Shen, Huan Zhang
- Prediction Is Not Calibration: Item Parameter Recovery and Representation Coupling in Knowledge TracingPapers · 21 Oct 2026 · Wenrui Yuan, Stéphanie M. van den Berg, Johannes Steinrücke
- A Measurement Perspective on Benchmarking LLM-Generated Text Detectors using Item Response TheoryPapers · 18 Oct 2026 · Yanbin Zhao, Zhipeng Chen, Guangsheng Bao, Guandong Zhang, Yan Li
- A Unified Response Framework for Questions and Tutoring DialoguesPapers · 14 Oct 2026 · Zhangqi Duan, Simon Woodhead, Maya Miller-Vedam, Andrew Lan
- On the estimation and validity of AI time horizons---a statistical look at the METR plotPapers · 8 Oct 2026 · Drew T. Nguyen, William Fithian
- Searching for "Harmful Refusal": A Psychometric Audit of an AI Safety BenchmarkPapers · 8 Oct 2026 · Christopher M. Stewart, Preston Botter, Natalie Sarabosing, Muye Zhang, Rachel P…