trends.barnas.net

phenomenon · first seen 7 Nov 2026

transformer attention dynamics

Also: attention dynamics

The time evolution of attention weights and token representations within transformer models.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

Fisher-Rao gradient flow