phenomenon · first seen 9 Oct 2026
vanishing gradient problem
Gradients shrinking exponentially through many time steps or layers, making long-range dependencies hard to learn.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The RNN Homunculus: Learning to Gate Long-Term MemoryPapers · 9 Oct 2026 · Zeyu Fan, Alexandru-Dragos Manolache, Jan van Gemert
Latest sources
- The RNN Homunculus: Learning to Gate Long-Term MemoryPapers · 9 Oct 2026 · Zeyu Fan, Alexandru-Dragos Manolache, Jan van Gemert