under 2% quality gap but 10x cost difference: tested 5 models on identical tool calling tasks[D]

In three linesBenchmark of 5 models (Opus 4.7, GPT-5, Sonnet 4.6, DeepSeek V4 Pro, Hunyuan Hy3) on 8 Python refactoring tasks with MCP. Quality gap <2% (96-99% first-attempt tool call success) but 10x cost difference: Opus $15, GPT-5 $11, Sonnet $4, DeepSeek <$2, Hunyuan $1.50.

Summary generated by Claude — human-verified