phenomenon · first seen 22 Oct 2026
attention as interacting particle system
Also: mean-field attention dynamics
Viewing attention blocks as particle systems whose mean-field limits are gradient flows over probability measures.
Mentions per week
PapersCodeDiscussion
Earliest sources
- SympFormer: Inertial Attention Blocks from Damped Hamiltonian Dynamics on Spaces of Probability MeasuresPapers · 22 Oct 2026 · Viktor Stein, Levin Maier, Wuchen Li, Gabriele Steidl
Latest sources
- SympFormer: Inertial Attention Blocks from Damped Hamiltonian Dynamics on Spaces of Probability MeasuresPapers · 22 Oct 2026 · Viktor Stein, Levin Maier, Wuchen Li, Gabriele Steidl