trends.barnas.net

phenomenon · first seen 6 Oct 2026

batch-invariant inference

Also: batch-induced nondeterminism, serving-context nondeterminism, batch invariance in LLM inference

Variation in model outputs caused by batch shape, hardware, or numerical precision changes during inference.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

bfloat16logit margin regularization