trends.barnas.net

method · first seen 13 Oct 2026

attention distillation

Transferring attention patterns from a teacher model to a student model to guide its internal correspondences.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

video diffusion modelanalog in-memory computingnoise-aware training