CSP-Atlas: Concept-Specific Neural Circuits in a Sparse Python Transformer

In three linesStudy identifies 106 dedicated neural circuits in a sparse 8-layer transformer trained on Python code. Circuits organize by computational principles (atomicity, lexical ambiguity) rather than semantics. Up to 62.5% of loudest-firing neurons at mid-to-late layers are concept-specific for AST constructs.

Summary generated by Claude — human-verified