trends.barnas.net

method · first seen 7 Oct 2026

delta distillation

Transferring a teacher's shift in logits relative to its base model rather than its full endpoint policy.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

multi-teacher on-policy distillation