Transformers Learn the Mestre-Nagao Heuristic
Signal
82
Hype
15
In three linesTwo-layer transformers classify rational elliptic curves (rank 0 vs 1) with >99% accuracy from 128 Frobenius traces. Mechanistic interpretability analysis reveals a sparse circuit of 20 neurons implements the Mestre-Nagao heuristic (weights log(p)/(p·log B), r=0.997), autonomously discovering an analytic number theory result.Read source
Your take?
Summary generated by Claude — human-verified