method · first seen 15 Nov 2026
vocabulary trimming
Also: token vocabulary pruning
Removing unused rows of a language model's token embedding and output tables to shrink the model for deployment.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The Vocabulary Tax: Safely Trimming Unused Tokens from LLMs for On-Device UsePapers · 15 Nov 2026 · Sattaya Singkul
Latest sources
- The Vocabulary Tax: Safely Trimming Unused Tokens from LLMs for On-Device UsePapers · 15 Nov 2026 · Sattaya Singkul