AgentKernelArena: Generalization-Aware Benchmarking of GPU Kernel Optimization Agents

In three linesAgentKernelArena is an open-source benchmark for evaluating AI agents on GPU kernel optimization. It contains 196 tasks (HIP-to-HIP, Triton-to-Triton, PyTorch-to-HIP) and tests generalization on unseen configurations. Tested agents (Cursor Agent, Claude Code, Codex) achieve speedups up to 6.89x, but show generalization weaknesses on PyTorch-to-HIP.

Summary generated by Claude — human-verified