Next-Latent Prediction Transformers [R]

In three linesMicrosoft Research presents Next-Latent Prediction (NextLat), a self-supervised learning method where transformers predict their own next latent state. This improves history compression into compact belief states, data efficiency, and accelerates inference up to 3.3x via recursive speculative decoding.

Summary generated by Claude — human-verified