trends.barnas.net

method · first seen 5 Oct 2026

auxiliary loss for memory pathway coordination

An extra training loss restricting attention's access to earlier context so recurrent state is used more.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

hybrid attention-recurrent language models