method · first seen 13 Oct 2026
quantized pretraining
Training large models with low-precision number formats for weights, activations, and gradients to reduce compute and memory.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Mixed Precision Scaling Laws for Quantized PretrainingPapers · 13 Oct 2026 · Jinuk Kim, Rajarshi Saha, Muhammed Fatih Balin, Youngsuk Park
Latest sources
- Mixed Precision Scaling Laws for Quantized PretrainingPapers · 13 Oct 2026 · Jinuk Kim, Rajarshi Saha, Muhammed Fatih Balin, Youngsuk Park