ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?

In three linesArcANE is an automatically constructed benchmark evaluating whether role-playing language agents maintain character psychological consistency across narrative phases. Built on 17 novels and 80 principal characters, it tests responses across story phases and unseen scenarios. Conditioning on Character Arc outperforms all other context strategies across 6 models and 6 context modes.

Summary generated by Claude — human-verified