method · first seen 5 Oct 2026
knowledge distillation from teacher model
Transferring a stronger teacher model's outputs into a student model to guide its training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- HuatuoGPT-3: RL-Only Domain Adaptation from Base ModelsPapers · 5 Oct 2026 · Junying Chen, Xinyuan Xie, Ziniu Li, Wenyuan Gu, Jianquan Li, Xiang Wan, Guangju…
Latest sources
- HuatuoGPT-3: RL-Only Domain Adaptation from Base ModelsPapers · 5 Oct 2026 · Junying Chen, Xinyuan Xie, Ziniu Li, Wenyuan Gu, Jianquan Li, Xiang Wan, Guangju…