method · first seen 13 Oct 2026
positional encoding
Also: position code, positional embedding, sine-cosine encoding
Adding position-dependent vectors to token embeddings so attention models can use order or location.
Mentions per week
PapersCodeDiscussion
Rank 33 on 16 Nov 2026 · 7 mentions in 28 days · 7 independent groups · papers → discussion · first seen 5 weeks ago · acceleration -0.07
Earliest sources
- Persistence Positional Encoding: A Minimal Transformer Recipe for Persistence DiagramsPapers · 13 Oct 2026 · Eunwoo Heo, Ganghyun Kim, Jaejun Yoo
- Beyond Static Positional Encoding: Bayesian Time-aware Attention for Non-Stationary Long-term Time Series ForecastingPapers · 14 Oct 2026 · Xinjie Lan, Yunbo Mei, Leheng Zhou, Hao Qi
- Rethinking Positional Encoding and Interaction Granularity for CTR PredictionPapers · 27 Oct 2026 · Xinxun Zhang, Yuxiang Wang, Xiaokai Zhou, Jiayue Li, Yi Li, Yue Liu, Jun Zhang,…
- A Positional Realizability Theory of Length Generalization in Single-Head AttentionPapers · 30 Oct 2026 · Jiasong Han, Yunkai Chai, Jintao Wang
- Causal Optimal-Transport Attention: Positional Priors and Length ExtrapolationPapers · 1 Nov 2026 · Ming Lian
- Positional Encoding is All You Need for Scalable Equivariance Constraint RelaxationPapers · 3 Nov 2026 · Hagay Michaeli, Haggai Maron, Daniel Soudry
Latest sources
- Understanding Positional Embeddings in Modern LLMsDiscussion · 15 Nov 2026 · vismit2000 · 246 points
- Where Do Vision-Language Models Get Left and Right? Position-Code Counterfactuals in Qwen2.5-VL, Qwen3-VL and InternVL3Papers · 10 Nov 2026 · Enhao Cui, Junzhi Yang, Yaoshun Lin, Yuhan Feng, Zijian Chen
- Continuous Angular Control in Text-to-Image Generation via Geometric Token EncodingPapers · 9 Nov 2026 · Furkan Güzelant, Basavaraj Sunagad, Aysegul Dundar, Adam Kortylewski
- Positional Encoding is All You Need for Scalable Equivariance Constraint RelaxationPapers · 3 Nov 2026 · Hagay Michaeli, Haggai Maron, Daniel Soudry
- Causal Optimal-Transport Attention: Positional Priors and Length ExtrapolationPapers · 1 Nov 2026 · Ming Lian
- A Positional Realizability Theory of Length Generalization in Single-Head AttentionPapers · 30 Oct 2026 · Jiasong Han, Yunkai Chai, Jintao Wang
- Rethinking Positional Encoding and Interaction Granularity for CTR PredictionPapers · 27 Oct 2026 · Xinxun Zhang, Yuxiang Wang, Xiaokai Zhou, Jiayue Li, Yi Li, Yue Liu, Jun Zhang,…
- Beyond Static Positional Encoding: Bayesian Time-aware Attention for Non-Stationary Long-term Time Series ForecastingPapers · 14 Oct 2026 · Xinjie Lan, Yunbo Mei, Leheng Zhou, Hao Qi
- Persistence Positional Encoding: A Minimal Transformer Recipe for Persistence DiagramsPapers · 13 Oct 2026 · Eunwoo Heo, Ganghyun Kim, Jaejun Yoo