method · first seen 9 Oct 2026
distributed inference
Also: distributed LLM inference
Running a single model's inference across multiple machines to share compute and memory load.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Deen-Media/dgx-monarchCode · 9 Oct 2026 · Deen-Media · 56 stars
- Dharshaneshwaran/hyperpodCode · 26 Oct 2026 · Dharshaneshwaran · 56 stars
- Shoestring-dev/StrixFoldCode · 28 Oct 2026 · Shoestring-dev · 73 stars
- The Blind Spots of Detection: Adversarial Perturbation Attacks against Watchdogs in Distributed LLM InferencePapers · 31 Oct 2026 · Siu Wai Shi, Xiaochen Zhu, Xinjian Luo, Keke Huang, Bingxue Zhang, Xiaofeng Gao
- DICOMPUTE: An Economic and Privacy-Aware Framework for Distributed Artificial Intelligence InferencePapers · 7 Nov 2026 · Atul Khekade, Ritesh Kakkad, Anil Chinchawale, Omkar Mestry, Behnam Mohammadkhan…
Latest sources
- DICOMPUTE: An Economic and Privacy-Aware Framework for Distributed Artificial Intelligence InferencePapers · 7 Nov 2026 · Atul Khekade, Ritesh Kakkad, Anil Chinchawale, Omkar Mestry, Behnam Mohammadkhan…
- The Blind Spots of Detection: Adversarial Perturbation Attacks against Watchdogs in Distributed LLM InferencePapers · 31 Oct 2026 · Siu Wai Shi, Xiaochen Zhu, Xinjian Luo, Keke Huang, Bingxue Zhang, Xiaofeng Gao
- Shoestring-dev/StrixFoldCode · 28 Oct 2026 · Shoestring-dev · 73 stars
- Dharshaneshwaran/hyperpodCode · 26 Oct 2026 · Dharshaneshwaran · 56 stars
- Deen-Media/dgx-monarchCode · 9 Oct 2026 · Deen-Media · 56 stars