method · first seen 8 Oct 2026
token-level routing
Routing each token of an LLM generation to a different model or expert during inference to balance cost and quality.
Mentions per week
PapersCodeDiscussion
Earliest sources
- thu-nics/TokenRouterCode · 8 Oct 2026 · thu-nics · 79 stars
Latest sources
- thu-nics/TokenRouterCode · 8 Oct 2026 · thu-nics · 79 stars