GENEB: Why Genomic Models Are Hard to Compare

In three linesGENEB is a large-scale diagnostic benchmark evaluating 40 genomic foundation models across 100 tasks in 13 functional categories under a unified probing protocol. Analysis shows aggregate leaderboards are unstable: model rankings vary sharply across task categories, scale provides modest and inconsistent gains, and architectural alignment frequently outweighs parameter count.

Summary generated by Claude — human-verified