trends.barnas.net

method · first seen 12 Nov 2026

reward function probing

A defense that inspects or probes reward signals to prevent learning from harmful objectives.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

harmful fine-tuning