Early-Signal Detector

phenomenon · first seen 6 Oct 2026

hyperparameter transfer

Also: proxy model search transfer

Reusing hyperparameters tuned on small proxy models for larger models by scaling rules that keep training dynamics stable.

Mentions per week

0319 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

muPmodel mergingLaplace approximationmodel ensemblingdata-constrained scalingFrank-Wolfe algorithmMuon-style spectral optimizer