method · first seen 3 Nov 2026
delta rule recurrence
Also: delta attention
Recurrent memory updates that correct stored state using a delta between proposed and current values.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Attending to Memory Writes Reduces Seed Variability in Recurrent Length GeneralizationPapers · 3 Nov 2026 · Sungwoo Goo, Hwi-yeol Yun, Sangkeun Jung
Latest sources
- Attending to Memory Writes Reduces Seed Variability in Recurrent Length GeneralizationPapers · 3 Nov 2026 · Sungwoo Goo, Hwi-yeol Yun, Sangkeun Jung