phenomenon · first seen 15 Oct 2026
evaluation awareness
Also: eval awareness
A language model's ability to detect that it is being tested, which can change its behaviour during evaluations.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?Papers · 15 Oct 2026 · Trizal Garg, Sibayan Mitra, Arya Karanjkar, Advait Singh, Jagat Sesh Challa, Yas…
- A Model Organism for Studying Unverbalized Evaluation AwarenessPapers · 16 Oct 2026 · Daniel Donnelly, Evan Chapple, Haritz Puerto, Sahar Abdelnabi
- ShutdownMod: Turning Any Trajectory into a Shutdown EvaluationPapers · 26 Oct 2026 · Param Biyani, Sebastien Luyasu, Cedric Potvliege, Divij Chawla, Elliott Thornley…
- Opening the Box Changes the Cat: LLMs Detect Chain-of-Thought Monitoring - What now?Papers · 29 Oct 2026 · Amir Jalilifard, Marcos Medeiros Raimundo, Anderson Rocha
- Eval Awareness vs. Eval ParanoiaDiscussion · 12 Nov 2026 · ezrasu · 62 points
Latest sources
- Eval Awareness vs. Eval ParanoiaDiscussion · 12 Nov 2026 · ezrasu · 62 points
- Opening the Box Changes the Cat: LLMs Detect Chain-of-Thought Monitoring - What now?Papers · 29 Oct 2026 · Amir Jalilifard, Marcos Medeiros Raimundo, Anderson Rocha
- ShutdownMod: Turning Any Trajectory into a Shutdown EvaluationPapers · 26 Oct 2026 · Param Biyani, Sebastien Luyasu, Cedric Potvliege, Divij Chawla, Elliott Thornley…
- A Model Organism for Studying Unverbalized Evaluation AwarenessPapers · 16 Oct 2026 · Daniel Donnelly, Evan Chapple, Haritz Puerto, Sahar Abdelnabi
- Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?Papers · 15 Oct 2026 · Trizal Garg, Sibayan Mitra, Arya Karanjkar, Advait Singh, Jagat Sesh Challa, Yas…