phenomenon · first seen 13 Oct 2026
reparameterization symmetry
Different parameter settings that represent the same function, which can change optimizer dynamics during training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Same Function, Different Trajectory: No Standard Optimizer Is Equivariant to Transformer ReparameterizationPapers · 13 Oct 2026 · Bum Jun Kim
Latest sources
- Same Function, Different Trajectory: No Standard Optimizer Is Equivariant to Transformer ReparameterizationPapers · 13 Oct 2026 · Bum Jun Kim