method · first seen 4 Oct 2026
self-distillation
Also: self-distillation training
A model serves as its own teacher by conditioning the same policy on privileged information.
Mentions per week
PapersCodeDiscussion
Earliest sources
- ASCENT: Online Test-Time Training of Long-Horizon Agents via Self-Distillation of Verified ExperiencePapers · 4 Oct 2026 · Haodong Lu, Dong Gong
- MeSD: Multi-Evidence Self-Distillation for VideoLLMPapers · 5 Oct 2026 · Weijie Zhu, Han Fang, Hanyu Fu, Yuzhe Zhang, Xin Wei, Zhaoyan Pan, Feiran Liu, X…
- RAISED: Self-Distillation for Robustness to Prompt Injection in LLM AgentsPapers · 5 Oct 2026 · Mohamed Dhouib, Clement Elliker, Alexi Canesse, Maël Jenny, Lucas-Andrei Thil,…
- SPECTRUM: Proximal Spectral Modulation for Looped Self-DistillationPapers · 5 Oct 2026 · Yunbo Long, WenJie Chen, Jiaquan Zhang, Guangya Hao, Zihang Zeng, Pengze Li, Xi…
- Unlocking Fine-Grained Perception in CLIP via Structurally-Aware Latent Masked ModelingPapers · 6 Oct 2026 · Juntong Li, Lingwei Dang, Haomin Wu, Ziyan Qiu, Qingxin Xiao, Qingyao Wu
- Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior ForesightPapers · 6 Oct 2026 · Haoxiang Zhang, Qinglin Chen, Hiroaki Hayashi, Zhuofeng Li, Siming Zhang, Jiaxin…
Latest sources
- Breaking feature collapse in self-supervised time series encodersPapers · 16 Nov 2026 · Özgün Turgut, Daniel Rueckert
- Glance, then Select: Evidence-Tempered Visual Token Selection for Extremely Compressed Multimodal LLMsPapers · 15 Nov 2026 · Yuxuan Wang, Guangxiang Zhao, Yuxuan Tian, Yahui Han, Xinyu Tan, Feiyu Wang, Zon…
- From Large Language Models to Efficient System One Models via Adaptive ComputationPapers · 12 Nov 2026 · Minh-Anh Nguyen
- Hint-Informed Self-Distillation for Reasoning SegmentationPapers · 11 Nov 2026 · Kunze Jiang, Yuchen Wang, Kang Li, Qixing Zhang
- AgentOPSD: Turn-Level Credit Assignment via Recursive Belief RevisionPapers · 9 Nov 2026 · Yizhuo Li
- Speculative Self-Distillation enables Efficient Knowledge InternalizationPapers · 9 Nov 2026 · Shayan Talaei, Agam Bhatia, Arshia Soltani Moakhar, Jonas Hübotter, Amin Saberi…
- Mosaic:montage-agnostic self-distilled graph learning for subject-independent ieeg seizure detectionPapers · 6 Nov 2026 · Arya Jalali, Mahsa Shoaran
- Steer, Don't Tell: Breaking Reasoning Plateaus with Reachability-Aligned Self-DistillationPapers · 31 Oct 2026 · Zijian Wu, Lingkai Kong, Lin Yang, Haiteng Zhao, Kuikun Liu, Kai Chen, Dahua Lin…
- MUON-RT Reusing the Teacher's Trajectory for Momentum-Free Muon for LLM Self-DistillationPapers · 30 Oct 2026 · Aryan Das, Vinay Kumar Verma, Aakansha Mishra
- SelfThinker: Self-Evolving Reasoning via Reliability-Verified Intrinsic Visual ThoughtsPapers · 29 Oct 2026 · Zhangquan Chen, Ruqi Huang
- XLaw-JP-27B: A Lightweight Open Model Specialized for Japanese LawPapers · 29 Oct 2026 · Andrew Shin
- Weaken to Strengthen: Weakening-Induced On-Policy Self-Distillation for Large Reasoning ModelsPapers · 28 Oct 2026 · Yecheng Wu, Song Han, Han Cai