Word Class Representations Spontaneously Emerge from Successor Representations Trained on Natural Language

In three linesResearchers train neural networks on WikiText-103 (103M tokens) using Successor Representations from RL to predict future word distributions. Without explicit linguistic supervision, grammatical categories (nouns, verbs, adjectives) spontaneously emerge and become separable via unsupervised clustering, organized by predictive horizon.

Summary generated by Claude — human-verified