trends.barnas.net

model · first seen 5 Oct 2026

ModernBERT

A modernized BERT-style encoder architecture with long context support and efficiency improvements.

Mentions per week

0319 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

masked language modelingcontinued pretrainingprotein language modellow-rank adaptationcalibrated confidence estimationlegal query classificationLatin language modelwarm-start pretraining