architecture · first seen 19 Oct 2026
normalized transformer
Also: nGPT
A transformer whose hidden representations are constrained to the unit hypersphere.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Spherical Fixed-Point Reasoners: Adaptive Loop Halting on the HyperspherePapers · 19 Oct 2026 · Arber Zela, Artavazd Maranjyan, Pol Puigdemont, David Berghaus, Valentyn Boreiko…
- Dory1.0-4B: A Looped Normalized-GPTPapers · 2 Nov 2026 · Maxim Fishman, Simeng Sun, Shantanu Acharya, Faisal Ladhak, Brian Chmiel, Santia…
Latest sources
- Dory1.0-4B: A Looped Normalized-GPTPapers · 2 Nov 2026 · Maxim Fishman, Simeng Sun, Shantanu Acharya, Faisal Ladhak, Brian Chmiel, Santia…
- Spherical Fixed-Point Reasoners: Adaptive Loop Halting on the HyperspherePapers · 19 Oct 2026 · Arber Zela, Artavazd Maranjyan, Pol Puigdemont, David Berghaus, Valentyn Boreiko…