method · first seen 6 Oct 2026
sequence packing
Also: packed sequences, continuous sequence packing, sequence packing for distributed training
Training data technique that concatenates multiple sequences into one fixed-length input to avoid padding waste.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Algorithmic Scratchpads and Curriculum Staging for Arithmetic Reasoning in Tiny TransformersPapers · 6 Oct 2026 · Sourabh Kasliwal
- Coordination-Free Workload Regularization for Variable-Cost Distributed TrainingPapers · 15 Oct 2026 · Tao Huang, Chen Zhu, Antonio Alonso, Daming Li, Adarsh Goura, Jaideep Ray, Yiton…
Latest sources
- Coordination-Free Workload Regularization for Variable-Cost Distributed TrainingPapers · 15 Oct 2026 · Tao Huang, Chen Zhu, Antonio Alonso, Daming Li, Adarsh Goura, Jaideep Ray, Yiton…
- Algorithmic Scratchpads and Curriculum Staging for Arithmetic Reasoning in Tiny TransformersPapers · 6 Oct 2026 · Sourabh Kasliwal