task · first seen 6 Oct 2026
long-context language modeling
Also: long context, long context window, long-context inference, long-context reasoning, long-context capability
Running language models over very long inputs, including selecting relevant evidence within them.
Mentions per week
PapersCodeDiscussion
Rank 193 on 16 Nov 2026 · 10 mentions in 28 days · 10 independent groups · papers → code · first seen 6 weeks ago · acceleration -0.20
Earliest sources
- Monte Carlo Estimation for KV Cache EvictionPapers · 6 Oct 2026 · Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer, Wajih Hassan Raza, Atta Ul As…
- UNREAL: Unifying Retrieval and Long-Context with a Single ModelPapers · 6 Oct 2026 · Edan Kinderman, Elad Hoffer, Yochai Blau, Brian Chmiel, Ron Banner, Daniel Soudr…
- Probing for Long-Horizon Deductive Reasoning Capabilities in Language Models with PrologPapers · 8 Oct 2026 · Hadeel Al-Negheimish, Jasna Ilieva, Yoon Kim
- FOLD: Position-Free Far Memory with Local Order for Long-Context Speculative DecodingPapers · 14 Oct 2026 · Shuxuan Li, Jialiang Kang, Yanghao Zhou, Ziye Zhu, Xiao Yang
- Long-Context Drafting Does Not Require Long-Context DraftersPapers · 14 Oct 2026 · Aref Jafari, Vansh Bhatia, Matt Qin, Subhajit Dutta Chowdhury, Ben Lee, Vikram A…
- Beyond Context Length: Characterising the Difficulty of Long-Context ReasoningPapers · 15 Oct 2026 · Shiwen Qin, Cameron Barker, Henry Gouk, Elliot J. Crowley, Shay B. Cohen, Mirell…
Latest sources
- Evaluating Large Language Models for Scientific Paper Search: Retrieval Success and Inference Latency on Mac Studio and NVIDIA A100Papers · 13 Nov 2026 · Frederic Andriantseheno Rakoto, Yannis Bendi-Ouis, Xavier Hinaut
- Where in the Input Does a One-Pass Decision Encoder Look?Papers · 12 Nov 2026 · Mohammed Nayeem Khan, Allan Kevin T
- LongCapHarness: Capability-Guided Auto-Harnessing for Long-Context ReasoningPapers · 7 Nov 2026 · Tao Zhang, Yuhang He
- Retrofitting Unbounded Context onto Stock Language ModelsPapers · 6 Nov 2026 · Mark Oskin
- DevDock-AI/SpeedyCode · 1 Nov 2026 · DevDock-AI · 78 stars
- GraphNIAH: A Benchmark for Long-Context Reasoning over Real-World GraphsPapers · 30 Oct 2026 · Minh-Nam Tran, Abulhair Saparov
- MaxDevv/lean-qwenflashCode · 24 Oct 2026 · MaxDevv · 67 stars
- Head Dimension Matters in Language Models for Long-Context RetrievalPapers · 23 Oct 2026 · Seiya Tokui, Shoichiro Yamaguchi, Sosuke Kobayashi
- LongZero: Enhancing Long-Context Reasoning in LLMs from Zero DataPapers · 21 Oct 2026 · Zhennan Wan, Jianfei Chen
- Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling LawPapers · 21 Oct 2026 · Ziqing Qiao, Xiaoyue Xu, Sikui Zhang, Yinuo Xu, Bingxiang He, Chaojun Xiao, Xu H…
- CSUNX233/Sparkle-Qwen27b-Kvmem-ninferCode · 15 Oct 2026 · CSUNX233 · 103 stars
- Beyond Context Length: Characterising the Difficulty of Long-Context ReasoningPapers · 15 Oct 2026 · Shiwen Qin, Cameron Barker, Henry Gouk, Elliot J. Crowley, Shay B. Cohen, Mirell…