DeepSWE benchmarks indicate that DeepSeek v4 Pro only passes 8% of tasks

In three linesReddit user reports DeepSeek v4 Pro achieves 8% pass rate on DeepSWE benchmark, contrasting with their perception of near-parity with Claude Sonnet 4.6 in practice. Link to DeepSWE benchmark provided.

Summary generated by Claude — human-verified