KVarN: new KV-cache quant from Huawei. 3–5× KV cache compression with actual speed-up instead of slow-down, and unlike TurboQuant it holds up on reasoning (Apache 2.0, vLLM single flag)

In three linesHuawei open-sources KVarN, a KV-cache quantization method (Apache 2.0, vLLM single-flag integration). 3–5× compression vs FP16, throughput up to 1.4× FP16, maintains reasoning quality unlike TurboQuant (Google). No retraining, no calibration required.

Summary generated by Claude — human-verified