method · first seen 7 Oct 2026
register tokens
Also: registers, high-norm outlier tokens
A small set of learned tokens that compress dense features into a compact representation for efficient processing.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Region-Aware CLS Token Augmentation for Fine-Grained Image RetrievalPapers · 7 Oct 2026 · Ian de Holanda Cavalcanti Bezerra, Vivek Trivedy, Lucas Pascotti Valem, Longin J…
- SparseWAM: Driving World-Action Models are Worth 16 Register TokensPapers · 8 Oct 2026 · Yixiang Yang, Lizhong Zhang, Xingyu Zhang, Zhiwen Chen, Jie Ling, Qiankun Yu, Xi…
- Decoding Register Tokens Preserves Global Scene DetailsPapers · 9 Oct 2026 · David Jacob Drexlin, Julius Hense, Jonas Dippel
- Exploring Attention Sinks in Text-to-Image Transformers from Diffusion and Autoregressive ModelsPapers · 9 Oct 2026 · Binglei Li, Mengping Yang, Zhiyu Tan, Wenxu Qian, Junping Zhang, Hao Li
- Acting Through RegistersPapers · 13 Oct 2026 · Yiwei Zhang, Yantai Yang, Jin Gao, Jin Lou, Andong Chen, Yufei Liu, Boyang Xing,…
- Patch-Derived or Register Tokens? Comparing Variable-Length Image TokenizersPapers · 24 Oct 2026 · Philipp Schenkel, Tobias Schürmann, Omer Sahin Tas
Latest sources
- Spread Too Thin: How Higher Resolution Dilutes a Vision Transformer's Attention, and a Training-Free RescalingPapers · 1 Nov 2026 · Neil D. B. Bruce
- Patch-Derived or Register Tokens? Comparing Variable-Length Image TokenizersPapers · 24 Oct 2026 · Philipp Schenkel, Tobias Schürmann, Omer Sahin Tas
- Acting Through RegistersPapers · 13 Oct 2026 · Yiwei Zhang, Yantai Yang, Jin Gao, Jin Lou, Andong Chen, Yufei Liu, Boyang Xing,…
- Exploring Attention Sinks in Text-to-Image Transformers from Diffusion and Autoregressive ModelsPapers · 9 Oct 2026 · Binglei Li, Mengping Yang, Zhiyu Tan, Wenxu Qian, Junping Zhang, Hao Li
- Decoding Register Tokens Preserves Global Scene DetailsPapers · 9 Oct 2026 · David Jacob Drexlin, Julius Hense, Jonas Dippel
- SparseWAM: Driving World-Action Models are Worth 16 Register TokensPapers · 8 Oct 2026 · Yixiang Yang, Lizhong Zhang, Xingyu Zhang, Zhiwen Chen, Jie Ling, Qiankun Yu, Xi…
- Region-Aware CLS Token Augmentation for Fine-Grained Image RetrievalPapers · 7 Oct 2026 · Ian de Holanda Cavalcanti Bezerra, Vivek Trivedy, Lucas Pascotti Valem, Longin J…