architecture · first seen 5 Oct 2026
manifold-constrained hyper-connections
Also: mHC
Transformer residual design widening the stream into parallel streams mixed by doubly stochastic matrices.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The Birkhoff Geometry of Manifold-Constrained Hyper-Connections: Two Channels, Vertex Viscosity, and Sinkhorn as a RetractionPapers · 5 Oct 2026 · Xiaoyu Li, Zhizhou Sha, Chiwun Yang
Latest sources
- The Birkhoff Geometry of Manifold-Constrained Hyper-Connections: Two Channels, Vertex Viscosity, and Sinkhorn as a RetractionPapers · 5 Oct 2026 · Xiaoyu Li, Zhizhou Sha, Chiwun Yang