method · first seen 15 Oct 2026
frozen embedding table
A fixed, non-trainable token embedding derived from a pretrained model, used to reduce trainable parameters.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language ModelsPapers · 15 Oct 2026 · Sai Kiran Bathula
Latest sources
- Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language ModelsPapers · 15 Oct 2026 · Sai Kiran Bathula