Back to feed
Reddit r/LocalLLaMA·

Some contrived tests comparing the accuracy of different Gemma and Qwen quantizations

Signal
72
Hype
15
In three linesEmpirical comparison of Gemma and Qwen quantizations across three tasks (arithmetic, presidential dates, attention). Gemma-4-31B-Q4_K_S reaches 83.8% arithmetic and 87% attention accuracy. Qwen3.6-27B-Q4_K_S achieves 95.5% arithmetic and 100% presidents. Results demonstrate major impact of model size and quantization scheme on accuracy.
Read source
Your take?
GeminiQwenEvalsBenchmarks

Summary generated by Claude — human-verified