Diffusion Gemma is 4x faster, but makes 6x more mistakes!

In three linesH100 (FP8) benchmark: DiffusionGemma 26B generates 763 tok/s (3.7s) vs Gemma4 218 tok/s (15.1s), but produces 28 factual errors across 61 tested facts vs 5 for Gemma4. DiffusionGemma invents names, dates, numbers (Clara Clley as Jobs' mother, BeBox at $9,999 instead of $1,600). The diffusion model generates 256 tokens simultaneously and polishes text without verifying factuality.

Summary generated by Claude — human-verified