moar QAT stuff and hairy ticks
Signal
65
Hype
15
In three linesRelease of quantized Gemma-4 models (12B and 31B) using an improved QAT method based on Q4_0. Author developed an iterative max-error search process in F16 outperforming imatrix, achieving KLD comparable to unsloth. PyTorch code available without restrictions.Read source
Your take?
Summary generated by Claude — human-verified