[llama.cpp] Asymmetric KV q8/q4 cache: current caveats and discussion in GGML repo

In three linesllama.cpp supports asymmetric KV caches (q8/q4) but currently falls back to CPU processing instead of GPU with CUDA for certain combinations. User evaluation shows q8_0/q4_0 costs only 1.3% precision loss while reducing memory by over 50% vs f16/f16.

Summary generated by Claude — human-verified