phenomenon · first seen 9 Oct 2026
surprisal
Also: self-information, information content, cross-entropy surprisal
The negative log-probability of a token, measuring how unexpected it is to a language model.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Modeling the Arrival Time of Information-Bearing Events in Natural LanguagePapers · 9 Oct 2026 · Leyi Lao, Yulin Ou, Yang Xu, Hao An
- Beyond Model Bias: Cross-Entropy Based Rankings in Literary and Academic Texts Remain Stable across Small Language ModelsPapers · 12 Oct 2026 · Ankit Bhattacharjee, Indrasabarna Hari, Krityapriya Bhaumik, Arka Das, Piyush Sa…
- Revisiting the Estimation of Unigram Surprisal in Computational PsycholinguisticsPapers · 13 Oct 2026 · Zachary Hopton, Francesco Ignazio Re, Samuel Kiegeland, Andreas Opedal, Eleanor…
- Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language ReadingPapers · 22 Oct 2026 · Abderrahmane Issam, Irene E. Winther, Stefan L. Frank
- Interpreting Classical Readability Formulae as SurprisalPapers · 31 Oct 2026 · Yo Ehara
- MEX: The Musical Expectation Benchmark SuitePapers · 1 Nov 2026 · Mathias Rose Bjare, Augustin Bouquillard, Giorgia Cantisani, Seung-Goo Kim, Stef…
Latest sources
- MEX: The Musical Expectation Benchmark SuitePapers · 1 Nov 2026 · Mathias Rose Bjare, Augustin Bouquillard, Giorgia Cantisani, Seung-Goo Kim, Stef…
- Interpreting Classical Readability Formulae as SurprisalPapers · 31 Oct 2026 · Yo Ehara
- Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language ReadingPapers · 22 Oct 2026 · Abderrahmane Issam, Irene E. Winther, Stefan L. Frank
- Revisiting the Estimation of Unigram Surprisal in Computational PsycholinguisticsPapers · 13 Oct 2026 · Zachary Hopton, Francesco Ignazio Re, Samuel Kiegeland, Andreas Opedal, Eleanor…
- Beyond Model Bias: Cross-Entropy Based Rankings in Literary and Academic Texts Remain Stable across Small Language ModelsPapers · 12 Oct 2026 · Ankit Bhattacharjee, Indrasabarna Hari, Krityapriya Bhaumik, Arka Das, Piyush Sa…
- Modeling the Arrival Time of Information-Bearing Events in Natural LanguagePapers · 9 Oct 2026 · Leyi Lao, Yulin Ou, Yang Xu, Hao An