method · first seen 7 Oct 2026
reverse KL divergence
Also: reverse KL, reverse Kullback-Leibler divergence
Divergence measure minimized by mode-seeking distillation objectives, contrasted with forward KL.
Mentions per week
PapersCodeDiscussion
Earliest sources
- On-Policy Distillation Teaches New Skills but Not New KnowledgePapers · 7 Oct 2026 · Yixuan Tang, Yi Yang
- GR-OPD: Group-Relative Sequence Credit for On-Policy DistillationPapers · 16 Oct 2026 · Yushu Wang, Renkai Yang, Jingcao Xu, Zili Geng, Haihong Tang, Yaohui Jin, Hao He
- Reverse-KL Policy Distillation: Statistical Guarantees and LimitsPapers · 22 Oct 2026 · Haolin Liu, Chen-Yu Wei, Julian Zimmert
- Adaptive-Policy Distillation: Knowledge Injection under Information AsymmetryPapers · 31 Oct 2026 · Hojun Cho, Kang Eun Jeon, Jaegul Choo
- O$^2$PD: Overlap-Gated On-Policy Distillation on Reliable PrefixPapers · 5 Nov 2026 · Shuaishuai Zu, Jihao Zhao, Pengfei Li, Guanghuan Fang, Ben Feng, Yuhan Liu, Biao…
Latest sources
- O$^2$PD: Overlap-Gated On-Policy Distillation on Reliable PrefixPapers · 5 Nov 2026 · Shuaishuai Zu, Jihao Zhao, Pengfei Li, Guanghuan Fang, Ben Feng, Yuhan Liu, Biao…
- Adaptive-Policy Distillation: Knowledge Injection under Information AsymmetryPapers · 31 Oct 2026 · Hojun Cho, Kang Eun Jeon, Jaegul Choo
- Reverse-KL Policy Distillation: Statistical Guarantees and LimitsPapers · 22 Oct 2026 · Haolin Liu, Chen-Yu Wei, Julian Zimmert
- GR-OPD: Group-Relative Sequence Credit for On-Policy DistillationPapers · 16 Oct 2026 · Yushu Wang, Renkai Yang, Jingcao Xu, Zili Geng, Haihong Tang, Yaohui Jin, Hao He
- On-Policy Distillation Teaches New Skills but Not New KnowledgePapers · 7 Oct 2026 · Yixuan Tang, Yi Yang