method · first seen 8 Oct 2026
quantized optimizer states
Also: low-bit optimizer states
Storing Adam-style optimizer moment estimates in low-bit formats to reduce memory during training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State QuantizationPapers · 8 Oct 2026 · Hanyang Li, Shao Tang, Daniel Thomas Braithwaite, Gregory Dexter, Leonardo Neves…
Latest sources
- Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State QuantizationPapers · 8 Oct 2026 · Hanyang Li, Shao Tang, Daniel Thomas Braithwaite, Gregory Dexter, Leonardo Neves…