VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark

In three linesVAMPS is a benchmark of 1,168 bilingual multimodal questions testing whether multimodal LLMs can solve mathematical problems by constructing and reasoning over graphs. Results show direct analytical solving outperforms tool-enabled visual solving across models, even on problems where plotting is the natural strategy.

Summary generated by Claude — human-verified