trends.barnas.net

phenomenon · first seen 20 Oct 2026

reward misspecification

Training rewards that differ from the true task intent, causing models to optimize unintended behaviors.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

reward hackingchain-of-thought monitoring