trends.barnas.net

method · first seen 4 Oct 2026

reasoning distillation

Transferring step-by-step reasoning ability from larger teacher models into smaller student models.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

knowledge distillationon-policy distillationsingle-pass classification with language modelsrejection samplingblack-box knowledge distillationtop-k vocabulary truncation for distillationlow-rank adaptation