Gemma 4 QAT accuracy inconsistencies

In three linesAnalysis of accuracy inconsistencies in Gemma 4 quantization-aware training (QAT). The 12B model shows larger deviations from FP16 compared to MoE variants (E2B/E4B), contradicting theoretical expectations. Requests clarification on methodology and comparisons with non-QAT variants.

Summary generated by Claude — human-verified