Early-Signal Detector

phenomenon · first seen 9 Oct 2026

heavy-tailed noise

Also: Student-t distribution

Stochastic gradient noise with infinite or very large higher moments, which degrades standard SGD guarantees.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Adamstochastic gradient Langevin Monte CarloDAG structure learningclipped stochastic gradient descentgradient clipping