Early-Signal Detector

phenomenon · first seen 9 Oct 2026

loss spikes in neural network training

Sudden, intermittent jumps in training loss observed during large model pre-training.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Adam