method · first seen 4 Oct 2026
LLM routing
Also: RouteLLM, AI router, cascading, LLM router, model routing, model cascading, LLM cascade routing
Selecting which model and token budget to use for each query to reduce serving cost while preserving quality.
Mentions per week
PapersCodeDiscussion
Rank 60 on 16 Nov 2026 · 29 mentions in 28 days · 29 independent groups · code → papers · first seen 6 weeks ago · acceleration +0.25
Earliest sources
- ardenmowbray/portkey-gatewayCode · 4 Oct 2026 · ardenmowbray · 30 stars
- TasteRoute: Personalized Routing for Video GenerationPapers · 5 Oct 2026 · Zhi Rui Tam, Chao-Chung Wu, Sin-Han Yang, Peyton Ku, Brendan Kuang, Tzu-Ting Hsi…
- Breaking the Tie: A Cluster-Aware Routing Framework for Large Language ModelsPapers · 5 Oct 2026 · Yao Lu, Zhaiyuan Ji, Yaxin Gao, Zeyu Wang, Zhe Tang, Jiaheng Wei, Zhaowei Zhu, S…
- Cross-lingual Calibration of Pre-Generation Success Probes for Multilingual LLM RoutingPapers · 5 Oct 2026 · Andrea Paganelli, Stefano Civelli, Pietro Bernardelle, Gianluca Demartini
- Evaluating Escalation Signals for LLM Routing: Targets, Controls, and Five Ways to Fool YourselfPapers · 5 Oct 2026 · Ramin Pishehvar, Andrea Morandi, Mahesh Viswanathan
- guregodevo/memdoorCode · 5 Oct 2026 · guregodevo · 408 stars
Latest sources
- Routing Beyond Task Categories: A Cost-Aware LAB-Bench StudyPapers · 16 Nov 2026 · Ahmed Tariq, Leo Guinan
- Small Language Models for Inference-Capability Routing: Effects of Model Capacity and Prompt Optimization on Downstream Quality and EfficiencyPapers · 12 Nov 2026 · Sailendra Kolluru, Maheshkumar Duvvarapu
- Smart Model Routing for Order-of-Magnitude LLM Cost ReductionPapers · 11 Nov 2026 · Hesham Elbakoury, Deep Shah, Ankur Sharma
- GLCR: Global-Local Collaborative Routing for Multi-Task Electromagnetic Signal ProcessingPapers · 11 Nov 2026 · Fang Lu, Yao Lu, Zhuangzhi Chen, Sicheng Zhang, Shanqing Yu, Yun Lin, Qi Xuan, G…
- SHADOWPREFILL: Keeping Your Next Model Warm for Per-Step Model Routing in Agentic LLM ServingPapers · 9 Nov 2026 · Haoran Qiu, Rohan Mahapatra, Rodrigo Fonseca, Mark Russinovich
- yanstd888/yanstd888.github.ioCode · 7 Nov 2026 · yanstd888 · 39 stars
- MultiTurnRoute: A Platform for Building and Evaluating Multi-Turn LLM RoutersPapers · 7 Nov 2026 · Jiaqi Xue, Mengxin Zheng, Heng Huang, Qian Lou
- Ensemble Routing for Prompt-Adaptive Cost-Aware LLM InferencePapers · 6 Nov 2026 · Saul Urso, Emanuele Carlini, Patrizio Dazzi, Matteo Mordacchini
- RouteAlign: Aligning Task Requirements with Model Profiles for LLM Service SelectionPapers · 5 Nov 2026 · Jihao Zhao, Ding Chen, Yanfang Chen, Bo Tang, Feiyu Xiong, Junchi Yan, Zhiyu Li
- Beyond K/V Caches: Cross-Model State Handoff in Hybrid Linear-Attention LLMsPapers · 5 Nov 2026 · Jiacheng Cai, Tao Zhang, Siqi Liang, Yun Dai, Ziqian Zeng
- Route Before Response: Fail-Closed Routing for LLM-Enabled Customer-Service SoftwarePapers · 5 Nov 2026 · Yuchen Cao, Zhenyu Mao, Jacky Wai Keung, Yifei Wang, Guancheng Lin, Jingyu Zhang
- Pathwise-Budgeted LLM Routing: Online Allocation with K-Bit Tail-Cost LearningPapers · 4 Nov 2026 · Hanzhang Qin, Sophie H. Yu, Yuewei Zhang, Zhi-Hai Zhang