trends.barnas.net

method · first seen 14 Oct 2026

forward Kullback-Leibler divergence

Also: forward KL

A divergence measuring how well a student distribution covers the teacher's probability mass.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

on-policy distillationJensen–Shannon divergence