trends.barnas.net

phenomenon · first seen 30 Oct 2026

two-layer ReLU network teacher-student model

Also: teacher-student setup

A setting where a student network learns to imitate a fixed teacher network to study learning dynamics and feature learning.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

gradient flowsymmetry breaking in neural network training