Early-Signal Detector

benchmark · first seen 13 Nov 2026

time between tokens

Also: TBT

Latency metric measuring the gap between consecutive generated tokens in streaming LLM responses.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

prefill-decode disaggregationLLM serving systems