Early-Signal Detector

method · first seen 5 Oct 2026

normalized stochastic gradient descent

Also: normalized SGD

Gradient descent where update magnitude is fixed by normalizing the gradient, decoupling step size from gradient norm.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

edge of stabilitydynamical mean-field theory