The Illusion of Specialization: Unveiling the Domain-Invariant "Standing Committee" in Mixture-of-Experts Models

In three linesAn arXiv study challenges the assumption that Mixture of Experts models achieve domain specialization through sparse routing. The COMMITTEEAUDIT framework reveals a domain-invariant "Standing Committee"—a compact coalition of experts capturing most routing mass across domains, layers, and budgets. Peripheral experts handle domain-specific knowledge alone.

Summary generated by Claude — human-verified