Not All MTP Assistants Are Created Equal

In three linesHands-on experience with MTP (Multi-Token Prediction) speculative decoding in llama.cpp. MTP assistants are not interchangeable: identical names and architectures don't guarantee same performance. Gemma 4 26B Q4: ~30 t/s → 55-62 t/s with correct assistant. Unquantized assistant models outperform Q4 versions (~10 t/s faster).

Summary generated by Claude — human-verified