method · first seen 16 Oct 2026
CPU-GPU collaborative inference
Splitting model computation between CPU and GPU to speed up inference under memory constraints.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Efficient CPU-GPU collaborative MoE inference via Adaptive Expert AssignmentPapers · 16 Oct 2026 · Wenhui Lv, Yunming Liao, Hongli Xu, Yang Xu, Junhao Cheng
Latest sources
- Efficient CPU-GPU collaborative MoE inference via Adaptive Expert AssignmentPapers · 16 Oct 2026 · Wenhui Lv, Yunming Liao, Hongli Xu, Yang Xu, Junhao Cheng