WAV: Multi-Resolution Block Residual Routing for Deep Decoder-Only Transformers

In three linesWAV v1 improves residual routing in deep Transformers by augmenting block summaries with directional detail bases (phase and split). On TinyStories and Text8, the method reduces validation loss at 48 layers (0.4738 vs 0.4960) with negligible additional parameters.

Summary generated by Claude — human-verified