method · first seen 11 Nov 2026
parallel decoding for shared-context inference
Also: Parallel Prompting
Decoding multiple questions over one shared document in a single request so the shared KV cache is read once per step.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Read Once, Answer Many: Parallel Prompting for Shared-Context LLM InferencePapers · 11 Nov 2026 · Zekun Zhao, Jeffrey Flanigan
Latest sources
- Read Once, Answer Many: Parallel Prompting for Shared-Context LLM InferencePapers · 11 Nov 2026 · Zekun Zhao, Jeffrey Flanigan