AI Coding Agents Can Reproduce Social Science Findings

In three linesSocSci-Repro-Bench, a benchmark of 221 tasks in social sciences, evaluates AI agents' ability to reproduce published findings. Claude Code substantially outperforms Codex, with reproduction rates exceeding previous LLM-based agent benchmarks. Agents also perform strongly on reasoning tasks identifying research questions and show results are not primarily driven by memorization.

Summary generated by Claude — human-verified