STT-Arena: A More Realistic Environment for Tool-Using with Spatio-Temporal Dynamics

In three linesSTT-Arena is a benchmark of 227 interactive tasks measuring LLMs' ability to detect and adapt to spatio-temporal changes. Claude-4.6-Opus achieves under 40% accuracy. Authors identify three recurring failure modes and propose STT-Agent-4B combining iterative trajectory refinement with online RL.

Summary generated by Claude — human-verified