A Training-Time Diagnostic for Generalization via the Log-Alignment Ratio

In three linesStudy of log-alignment ratio (LAR), a parameter-activation alignment metric. LAR predicts memorization-to-generalization transition in grokking (effective dimension k ≈ n^(2(1-LAR))) and 3B-parameter language model pre-training. Computable without validation data, negligible overhead.

Summary generated by Claude — human-verified