Evaluating Interactive Reasoning in Large Language Models: A Hierarchical Benchmark with Executable Games

In three linesInteractive reasoning evaluation benchmark with 474 executable games. LLMs receive only task rules, must query a hidden environment, integrate partial observations, and decide when to submit answers. Evaluates contextual robustness, metacognitive adaptation, and interaction efficiency across frontier models.

Summary generated by Claude — human-verified