model · first seen 5 Oct 2026
ModernBERT
A modernized BERT-style encoder architecture with long context support and efficiency improvements.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Domain adaptation of Russian ModernBERT for long legal documentsPapers · 5 Oct 2026 · I. Litvak, D. Gvozdetsky, F. Lashkin, V. Kirova, S. Lagutin, V. Volf, T. Maksiya…
- ProtModernBERT: Compute-Efficient Protein Language ModelingPapers · 14 Oct 2026 · Alberto Martínez, Natalia Flechas Manrique, Llorenç Espinosa-Portalés, Luc An…
- Beveridge: Open Weight System One Decision Models with Calibrated ProbabilitiesPapers · 17 Oct 2026 · Sathiskumar Jothi
- Legal Guidance in the Wild: How Users Seek Legal Help in Real-World LLM ConversationsPapers · 18 Oct 2026 · Amirreza Mohseni, Gerasimos Spanakis
- LAMB: A Modern Contextual Language Model for LatinPapers · 22 Oct 2026 · Aidan McCarthy
- Beyond IceBERT: Open-Data ModernBERT Encoders for Icelandic from 12M to 1B ParametersPapers · 26 Oct 2026 · Hafsteinn Einarsson
Latest sources
- Beyond IceBERT: Open-Data ModernBERT Encoders for Icelandic from 12M to 1B ParametersPapers · 26 Oct 2026 · Hafsteinn Einarsson
- LAMB: A Modern Contextual Language Model for LatinPapers · 22 Oct 2026 · Aidan McCarthy
- Legal Guidance in the Wild: How Users Seek Legal Help in Real-World LLM ConversationsPapers · 18 Oct 2026 · Amirreza Mohseni, Gerasimos Spanakis
- Beveridge: Open Weight System One Decision Models with Calibrated ProbabilitiesPapers · 17 Oct 2026 · Sathiskumar Jothi
- ProtModernBERT: Compute-Efficient Protein Language ModelingPapers · 14 Oct 2026 · Alberto Martínez, Natalia Flechas Manrique, Llorenç Espinosa-Portalés, Luc An…
- Domain adaptation of Russian ModernBERT for long legal documentsPapers · 5 Oct 2026 · I. Litvak, D. Gvozdetsky, F. Lashkin, V. Kirova, S. Lagutin, V. Volf, T. Maksiya…