OmniCode: A Benchmark for Evaluating Software Engineering Agents

In three linesOmniCode is a benchmark for evaluating AI agents on software engineering tasks. It contains 1794 tasks across Python, Java, and C++ covering bug fixing, test generation, code review fixing, and style fixing. Evaluations show SWE-Agent achieves only 25% on C++ test generation with DeepSeek-V3.1.

Summary generated by Claude — human-verified