trends.barnas.net

method · first seen 5 Oct 2026

continued pretraining

Also: domain-adaptive pretraining

Further pretraining of an already pretrained model on domain-specific corpora to adapt it to a target domain.

Mentions per week

0419 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Rank 64 on 9 Nov 2026 · 6 mentions in 28 days · 5 independent groups · papers · first seen 5 weeks ago · acceleration +3.33

Earliest sources

Latest sources

Mentioned together with

ModernBERTmasked language modelingmixture of expertsmachine translationGemmamembership inference attackretrieval-augmented generationtool callingdepression detection from social media textself-supervised learning