method · first seen 5 Oct 2026
gated delta rule
Also: delta rule, gated delta-rule memory, delta rule memory update
A recurrent memory update that writes key-value associations by correcting the prediction error, with gating controlling overwrite strength.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Voltic: Distinguishing Volatility from Stochasticity in Recurrent MemoryPapers · 5 Oct 2026 · Parsa Hejabi, Morteza Dehghani, Payam Piray
- Kronecker Delta Rule for Long Context Linear AttentionPapers · 19 Oct 2026 · Anamaria-Roberta Hartl, Levente Zólyomi, Michael List, Günter Klambauer, Sebas…
- NX-AI/KronLSTMCode · 19 Oct 2026 · NX-AI · 65 stars
- Dual DeltaNet: Value-Side Memory Reorganization for Linear AttentionPapers · 28 Oct 2026 · Yixiao Qian, Yaxin Zhang, Song Chen, Jiaxu Liu, Shengze Cai, Chao Xu
- Muir: Linear Attention with Sensitivity-Allocated Gating and Matched-Filter ReadoutPapers · 5 Nov 2026 · Tushaar Gangavarapu, Gil Tabak, Clemens JS Schaefer
Latest sources
- Muir: Linear Attention with Sensitivity-Allocated Gating and Matched-Filter ReadoutPapers · 5 Nov 2026 · Tushaar Gangavarapu, Gil Tabak, Clemens JS Schaefer
- Dual DeltaNet: Value-Side Memory Reorganization for Linear AttentionPapers · 28 Oct 2026 · Yixiao Qian, Yaxin Zhang, Song Chen, Jiaxu Liu, Shengze Cai, Chao Xu
- NX-AI/KronLSTMCode · 19 Oct 2026 · NX-AI · 65 stars
- Kronecker Delta Rule for Long Context Linear AttentionPapers · 19 Oct 2026 · Anamaria-Roberta Hartl, Levente Zólyomi, Michael List, Günter Klambauer, Sebas…
- Voltic: Distinguishing Volatility from Stochasticity in Recurrent MemoryPapers · 5 Oct 2026 · Parsa Hejabi, Morteza Dehghani, Payam Piray