ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents

In three linesClawForge is a benchmark framework for CLI agents testing persistent state and conflict handling. 17 scenarios, 6 ability categories. Seven frontier models evaluated: best score 45.3%, widest gap 17-90% driven by whether agents inspect existing state before acting.

Summary generated by Claude — human-verified