method · first seen 6 Oct 2026
logarithmic attention scaling
Also: log n scaled attention
Attention modification that scales logits by log of sequence length to keep attention focused on longer inputs.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Exact-Solution Volume and Length Generalization in TransformersPapers · 6 Oct 2026 · Yijia Jessica Zhu, David Chiang
Latest sources
- Exact-Solution Volume and Length Generalization in TransformersPapers · 6 Oct 2026 · Yijia Jessica Zhu, David Chiang