method · first seen 15 Nov 2026
RetroMAE
Retrieval-oriented masked autoencoder pretraining that trains the [CLS] vector explicitly for dense text representation.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Bioformer-RetroMAE: retrieval-oriented pretraining of a compact biomedical language model for literature searchPapers · 15 Nov 2026 · Jialu Li, Li Fang
Latest sources
- Bioformer-RetroMAE: retrieval-oriented pretraining of a compact biomedical language model for literature searchPapers · 15 Nov 2026 · Jialu Li, Li Fang