Tensor split mode: CUDA error on latest llama.cpp with Qwen-3.6-27b
Signal
35
Hype
15
In three linesUser encounters CUDA error with llama.cpp tensor split mode on Qwen-3.6-27b with dual RTX 3090s. Tensor split mode lacks llama_params_fit implementation, causing NCCL crash during model warmup.Read source
Your take?
Summary generated by Claude — human-verified