architecture · first seen 13 Oct 2026
serverless inference
Deploying model inference as on-demand, auto-scaled functions that share GPU resources.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Stable Token-level Scheduling for Serverless LLM InferencePapers · 13 Oct 2026 · Hardi Ashishbhai Desai, Balaji N K, Sourav Kanti Addya
- GearUp: DAG-aware Acceleration for Serverless Inference Serving via Slack-guided Pre-loadingPapers · 28 Oct 2026 · Qi Qi, Yifan Sui, Hanfei Yu, Hong Zhang, Hao Wang
Latest sources
- GearUp: DAG-aware Acceleration for Serverless Inference Serving via Slack-guided Pre-loadingPapers · 28 Oct 2026 · Qi Qi, Yifan Sui, Hanfei Yu, Hong Zhang, Hao Wang
- Stable Token-level Scheduling for Serverless LLM InferencePapers · 13 Oct 2026 · Hardi Ashishbhai Desai, Balaji N K, Sourav Kanti Addya