Early-Signal Detector

method · first seen 4 Oct 2026

stop-gradient normalization

Normalization in which the backward pass ignores part of the denominator while the forward pass uses the full sum.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

attention sinksoftpick attention