phenomenon · first seen 11 Oct 2026
second-moment structure
The effect of adaptive optimizer second-moment statistics on how networks respond to further learning.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Matched Specialization, Different Adaptation: Second-Moment Structure in Shared RepresentationsPapers · 11 Oct 2026 · Toru Takahashi
Latest sources
- Matched Specialization, Different Adaptation: Second-Moment Structure in Shared RepresentationsPapers · 11 Oct 2026 · Toru Takahashi