Uncovering the Latent Potential of Deep Intermediate Representations

In three linesStudy showing task-relevant information is distributed non-monotonically across layers in foundational models. Introduces LOES (Layer-wise Optimal Embedding Selection), a spectral method identifying task-discriminative subspaces, and GeoReg, geometric regularization enforcing simplicial structure on class manifolds. Consistent improvements across architectures and modalities.

Summary generated by Claude — human-verified