Nothing from Something: Can a Language Model Discover 0?

In three linesStudy on language models' ability to discover the mathematical concept of zero. GPT-2-sized models fail without additional training, but improve substantially after exposure to tens or hundreds of examples. Language pretraining reduces required examples by ~50%.

Summary generated by Claude — human-verified