GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Games

In three linesGVGAI-LLM is a video game benchmark for evaluating spatial reasoning and problem-solving in LLMs. Built on the General Video Game AI framework, it contains 118 ASCII games testing planning and logical reasoning. Zero-shot evaluations reveal persistent limitations of current models in spatial reasoning, partially improved by structured prompting.

Summary generated by Claude — human-verified