architecture · first seen 5 Oct 2026
hyper-connections
Also: HC
Residual connection generalization that uses multiple parallel residual streams in a Transformer.
Mentions per week
PapersCodeDiscussion
Earliest sources
- The Birkhoff Geometry of Manifold-Constrained Hyper-Connections: Two Channels, Vertex Viscosity, and Sinkhorn as a RetractionPapers · 5 Oct 2026 · Xiaoyu Li, Zhizhou Sha, Chiwun Yang
- Manifold-Constrained Residual Adaptation with Frame-Adaptive Layer Aggregation for Speaker VerificationPapers · 19 Oct 2026 · Zezhong Jin, Xiaoyu Wang, Zhe Li, Chong-Xin Gan, Siqing Qin, Man-Wai Mak, Kong A…
- On the Design of Hyper-Connections: Simplification, Stability, and ScalabilityPapers · 4 Nov 2026 · Xiangdong Zhang, Xiaohan Qin, Sunan Zou, Tuo Dai, Bizhao Shi, Zhuo Xia, Yebin Ya…
Latest sources
- On the Design of Hyper-Connections: Simplification, Stability, and ScalabilityPapers · 4 Nov 2026 · Xiangdong Zhang, Xiaohan Qin, Sunan Zou, Tuo Dai, Bizhao Shi, Zhuo Xia, Yebin Ya…
- Manifold-Constrained Residual Adaptation with Frame-Adaptive Layer Aggregation for Speaker VerificationPapers · 19 Oct 2026 · Zezhong Jin, Xiaoyu Wang, Zhe Li, Chong-Xin Gan, Siqing Qin, Man-Wai Mak, Kong A…
- The Birkhoff Geometry of Manifold-Constrained Hyper-Connections: Two Channels, Vertex Viscosity, and Sinkhorn as a RetractionPapers · 5 Oct 2026 · Xiaoyu Li, Zhizhou Sha, Chiwun Yang