method · first seen 12 Oct 2026
layer normalization
Also: LN, LayerNorm
Normalizing activations across features within a layer to stabilize neural network training.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Counting with Attention and LayerNorm: Norm Scaling and Representation GeometryPapers · 12 Oct 2026 · Ayyub Shaffy, Manoj Dhakal, Safal Shrestha, Keith W. Ross
- Activation-Adjacent Layer Normalization: Effects on Approximation PowerPapers · 15 Oct 2026 · Yunhao Ni, Yuxin Guo, Jie Luo, Wenjun Wu, Lei Huang
- LENS: Replacing LayerNorm and Softmax in Transformers with Learnable Normalization StatesPapers · 15 Nov 2026 · Yuhao Liu, Salim Ullah, Akash Kumar
Latest sources
- LENS: Replacing LayerNorm and Softmax in Transformers with Learnable Normalization StatesPapers · 15 Nov 2026 · Yuhao Liu, Salim Ullah, Akash Kumar
- Activation-Adjacent Layer Normalization: Effects on Approximation PowerPapers · 15 Oct 2026 · Yunhao Ni, Yuxin Guo, Jie Luo, Wenjun Wu, Lei Huang
- Counting with Attention and LayerNorm: Norm Scaling and Representation GeometryPapers · 12 Oct 2026 · Ayyub Shaffy, Manoj Dhakal, Safal Shrestha, Keith W. Ross