method · first seen 4 Oct 2026
stop-gradient normalization
Normalization in which the backward pass ignores part of the denominator while the forward pass uses the full sum.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Underscoring the Problem: Why Softpick Fails at InitializationPapers · 4 Oct 2026 · Aryan Sood, Jaikaran Singh, Ishaan Bansal
Latest sources
- Underscoring the Problem: Why Softpick Fails at InitializationPapers · 4 Oct 2026 · Aryan Sood, Jaikaran Singh, Ishaan Bansal