trends.barnas.net

method · first seen 8 Oct 2026

softmax attention

Attention mechanism normalizing query-key scores with softmax to weight values.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

layer normalizationGaussian mixture modelMuon optimizermaximum inner product search