Interesting paper advocates for quantized prefilling and precise decoding

In three linesPaper proposes Mix-Quant: use W4A4 quantization for prefilling (theoretical 4x speedup) but keep full precision for decoding. Prefilling tolerates quantization errors since they don't accumulate, unlike autoregressive decoding where each token affects subsequent generation.

Summary generated by Claude — human-verified