Back to feed
arXiv cs.AI·

DynMuon: A Dynamic Spectral Shaping View of Muon

Signal
78
Hype
15
In three linesDynMuon extends Muon by replacing update M with U·Σ^p·V† using dynamic parameter p. Theory shows positive p accelerates signal contraction early by emphasizing high-curvature directions, while mildly negative p reallocates update strength to low-curvature directions late in training. DynMuon reduces steps to target loss by 10.6-26.5% versus Muon.
Read source
Your take?
ReasoningBenchmarks

Summary generated by Claude — human-verified