method · first seen 4 Oct 2026
multi-token prediction
Also: block prediction, phrase-level drafting
Training language models to predict several future tokens at each position rather than only the next one.
Mentions per week
PapersCodeDiscussion
Rank 154 on 2 Nov 2026 · 13 mentions in 28 days · 13 independent groups · papers → code · first seen 4 weeks ago · acceleration -0.29
Earliest sources
- Greedy Local Learning for Language Model Pretraining: Gaps and Objective DesignPapers · 4 Oct 2026 · Jihwan Moon, Sheir A. Zaheer, Jinmyoung Lee, Gunhee Kim, Chan Y. Park
- LightMTP: Lightweight Latent Multi-Token PredictionPapers · 5 Oct 2026 · Tamara Czinczoll, Julie Kallini, Gerard de Melo, Chen Shani
- professorpalmer/mirai-s-adaCode · 6 Oct 2026 · professorpalmer · 110 stars
- Personalized LLM Recommendation with Semantic IDs: Autoregressive Beam Search vs. Multi-Token PredictionPapers · 11 Oct 2026 · Sejoon Oh, Fernando Amat Gil, Evan Smothers, Dan Iter, Mark Thornburg, Dawit Mur…
- HyCo: Hybrid Drafting for Cost-Efficient Mobile-Cloud Speculative DecodingPapers · 15 Oct 2026 · Hanbin Bae, Heejin Choi, Joohyung Lee, Byoung Jin Choi, Sangjun Park, Hoon-Young…
- ECHO: Efficient Causal Self-Recursion Beyond Auxiliary Multi-Token PredictionPapers · 17 Oct 2026 · Yuxuan Zhou, Junyuan Shang, Tianyu Wang, Chunrui Zheng, Zichang Liu, Wenbin Chan…
Latest sources
- Vaibhaav-Tiwari/deepseek-v3-jaxCode · 13 Nov 2026 · Vaibhaav-Tiwari · 238 stars
- mizorewww/colab-qwen38-g4Code · 10 Nov 2026 · mizorewww · 55 stars
- Phrase-Level Speculative Decoding on a Frozen TargetPapers · 9 Nov 2026 · Madhusudhana Naidu
- Generative Search and Recommendation at ShopifyPapers · 5 Nov 2026 · Juhana Kangaspunta, Khalil Hajji, Darshan Fofadiya, Kyumin Park, Michael Garner,…
- Lookahead Prediction-Guided Adaptive Visual Refocusing for Interleaved Multimodal ReasoningPapers · 2 Nov 2026 · Mengzhao Wang, Yanli Ji, Peng Ye
- Multi-Token Prediction Done RightPapers · 28 Oct 2026 · Jayden Teoh
- JaydenTeoh/Soft-MTPCode · 27 Oct 2026 · JaydenTeoh · 104 stars
- Multi-Token Prediction and Alternative Tokenization Improve Learning Latent Multi-Hop Graph Search at ScalePapers · 22 Oct 2026 · Arvid Frydenlund, FuTe Wong, Katherine Lambert, Frank Rudzicz
- Leonccaa/ReVoltaCode · 20 Oct 2026 · Leonccaa · 61 stars
- Adaptive Multi-Token Prediction: How far should we go?Papers · 20 Oct 2026 · Emile Anand, Mohammed Rehan Parwani, Xinyuan Cao
- BitMTP: When Multi-Token Prediction Meets Low-Bit Large Language ModelsPapers · 20 Oct 2026 · Ning Zhang, Shihao Wang, Jinrui Zhang, Chaodong Xiao, Lei Zhang
- ProVe: Proposer-Verifier DecodingPapers · 20 Oct 2026 · Ziqi Jin, Weiwen Xu, Jiaxi Li, Yujie Zhong, Qi She, Aixin Sun