trends.barnas.net

architecture · first seen 6 Oct 2026

DeltaNet

Also: delta rule linear attention

A linear-attention recurrent architecture that updates a memory matrix with a delta rule.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

test-time trainingpredictive codinglinear attentionchunkwise parallel training