Locality Does Not Imply Reachability: Boundary Repair in Block-Sparse Causal Attention

In three linesTheoretical paper on fixed block-sparse causal attention: adjacent tokens can be disconnected in the attention graph at every depth. Authors formalize this via structural dependency sets and propose Boundary Bridge Attention, a parameter-free repair using auxiliary causal edges near block boundaries with shared projections.

Summary generated by Claude — human-verified