trends.barnas.net

phenomenon · first seen 8 Oct 2026

emergent misalignment

Broad misalignment that appears in a model after narrow fine-tuning on data containing problematic content unrelated to the evaluated tasks.

Mentions per week

0419 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Rank 132 on 16 Nov 2026 · 6 mentions in 28 days · 6 independent groups · papers · first seen 6 weeks ago · acceleration +1.61

Earliest sources

Latest sources

Mentioned together with

low-rank adaptationmodel coherencegroup relative policy optimizationout-of-distribution generalizationsynthetic document finetuningactivation patchingcounterfactual data augmentationreward modelingbehavioral couplinggradient-based attribution