Spectral Scaling Laws of Muon

In three linesSystematic study of spectral behavior in Muon, an orthonormalization-based optimizer using Newton-Schulz iteration. Across 77M-2.8B parameter models, singular value quantiles of momentum buffers stabilize following power laws dependent on layer depth (exponents M^-0.25 to M^-0.96). Implications for NS configuration at frontier scale.

Summary generated by Claude — human-verified