TBP-mHC: full expressivity for manifold-constrained hyper connections through transportation polytopes

In three linesTBP-mHC proposes Birkhoff polytope parameterizations for manifold-constrained Hyper-Connections. The method constructs exactly doubly stochastic mixing matrices with (n-1)² degrees of freedom, avoiding iterative normalization and combinatorial explosion. Competitive results on language model pre-training with improved stability and scalability.

Summary generated by Claude — human-verified