phenomenon · first seen 4 Oct 2026
scaling law
Also: power law scaling, neural scaling laws
Empirical power-law-like relationships between model performance and model size or data.
Mentions per week
PapersCodeDiscussion
Rank 26 on 16 Nov 2026 · 32 mentions in 28 days · 31 independent groups · papers → discussion · first seen 6 weeks ago · acceleration -0.01
Earliest sources
- Selecting Repetition Counts Across Model Scales in Data-Constrained PretrainingPapers · 4 Oct 2026 · Ziyue WANG, T. Kanamori
- A Unified Scaling Law for Time Series Foundation ModelsPapers · 4 Oct 2026 · Xilin Dai, Yiding Liu, Zewei Dong, Jiang-Ming Yang, Qiang Xu
- What Is a Repeated Token Worth? The Scaling Geometry of Multi-Epoch PretrainingPapers · 4 Oct 2026 · Yekun Chai, Haoyi Xiong
- Training and Scaling Compute-Optimal Physiological Waveform Foundation ModelsPapers · 5 Oct 2026 · Pingzhi Li, Jie Peng, Shuqing Luo, Zachary Plotkin, Tianlong Chen
- Scaling Down the Scaling Laws: Parameter Efficiency and Compute-Optimal Training in Resource-Constrained Large Language ModelsPapers · 5 Oct 2026 · Joe Dwyer
- How to scale your HEP ML models: A recipe for robust architecture comparisons at scalePapers · 5 Oct 2026 · Matthias Vigl, Nikita Pond, Jackson Barr, Alexander Froch, Dan Guest, Nicole Har…
Latest sources
- Latent Feedback Is a Compute and Data AmplifierPapers · 16 Nov 2026 · Benhao Huang, Chaitanya Dwivedi, Xuezhe Ma, Alexander Moreno, Hector Liu
- Condensing Law of Security InformationPapers · 13 Nov 2026 · Qi Tan, Tianyu Cui, Qi Li, Ke Xu
- ArchSpace: Recording, Reviewing, and Referencing LLM Architecture ResearchPapers · 12 Nov 2026 · Jie Wang, Tong Zhu, Jiahao Kuang, Zhe Xu, Mowen Ruan, Yunkai Chai, Yuliang Liu,…
- When and How SignSGD Outperforms SGD: A Functional Scaling Law PerspectivePapers · 12 Nov 2026 · Zilin Wang, Binghui Li, Jia-Nan Wang, Lean Wang, Jinbo Wang, Lei Wu
- Physics-based simulation unlocks scaling laws for generalizable MRI reconstructionPapers · 11 Nov 2026 · Hong Shang, Zijian Zhan, Sen Jia, Xiang Fan, Jintao Meng, Yang Zhou, Xiang Zhou,…
- Are Scaling Laws of Universal MLIPs Universal?Papers · 11 Nov 2026 · Theo Keane, Anthony Onwuli, Richard Tomsett, Robert M. Forrest, Jonathan J. Bean
- Beyond the Log-Linear Frontier: Pre-Asymptotic Analysis of Finite-Budget Neural Scaling LawsPapers · 10 Nov 2026 · Tianyu Zhao, Zhixiang Ren
- LAION-Audio-XL: A Web-Scale Corpus and Scaling Studies for Contrastive Language-Audio PretrainingPapers · 8 Nov 2026 · Gijs Wijngaard, Felix Förster, Ross Wightman, Marianna Nezhurina, Christoph Sch…
- Semiprime Factorization with Discrete Diffusion and Beam Search: Scaling LawsPapers · 6 Nov 2026 · Brendan O Donoghue, Nenad Tomasev, Volodymyr Mnih, Timothy Nguyen, Dalin Guo, Ar…
- Using Transformers to Generate 3-Manifold TriangulationsPapers · 5 Nov 2026 · Daniel Bruwel, Ashvni Narayanan, Jonathan Spreer
- Open-HumanWAM: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation ModelsPapers · 4 Nov 2026 · Juncheng Ma, Jiaxin Li, Jiankai Tu, Bo Liang, Guodong Lv, Yufan Deng, Junzhe Tan…
- Quadrillion-parameter transformers and how to train themDiscussion · 3 Nov 2026 · frozenseven · 64 points