trends.barnas.net

architecture · first seen 22 Oct 2026

per-layer embeddings

Also: PLE

Language model design giving each transformer layer its own token embedding table, scaling embedding parameters alongside computation.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

vector quantizationmodel compression