phenomenon · first seen 13 Oct 2026
bias in LLM judges
Systematic distortions in LLM evaluators, such as position, verbosity, or self-family preference, that affect verdicts beyond answer quality.
Mentions per week
PapersCodeDiscussion
Earliest sources
- A CaLLM Judge is a Better Judge: Mitigating Bias in LLM-as-a-judgePapers · 13 Oct 2026 · Cesare Barbera, Luca Stradiotti, Lorenzo Cascioli, Lorenzo Perini, Niek Tax, Dan…
- Cheap, Consistent, Calibrated, but Biased? Typed Decision Models as JudgesPapers · 13 Oct 2026 · Fabian Lukassen, Christoph Weisser, Alexander Silbersdorff
Latest sources
- Cheap, Consistent, Calibrated, but Biased? Typed Decision Models as JudgesPapers · 13 Oct 2026 · Fabian Lukassen, Christoph Weisser, Alexander Silbersdorff
- A CaLLM Judge is a Better Judge: Mitigating Bias in LLM-as-a-judgePapers · 13 Oct 2026 · Cesare Barbera, Luca Stradiotti, Lorenzo Cascioli, Lorenzo Perini, Niek Tax, Dan…