method · first seen 7 Oct 2026
8-bit Adam
Adam optimizer variant storing its moment estimates in 8-bit quantized form to reduce memory.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Phase-HDC: Replacing Optimizer History with Gradient Thresholds in Discrete Phase LearningPapers · 7 Oct 2026 · Ahmed Nebli
Latest sources
- Phase-HDC: Replacing Optimizer History with Gradient Thresholds in Discrete Phase LearningPapers · 7 Oct 2026 · Ahmed Nebli