trends.barnas.net

method · first seen 6 Oct 2026

sequence packing

Also: packed sequences, continuous sequence packing, sequence packing for distributed training

Training data technique that concatenates multiple sequences into one fixed-length input to avoid padding waste.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

mixture of expertscurriculum learningchain-of-thought scratchpadload balancing in distributed training