Back to feed
Reddit r/LocalLLaMA·

Tensor split mode: CUDA error on latest llama.cpp with Qwen-3.6-27b

Signal
35
Hype
15
In three linesUser encounters CUDA error with llama.cpp tensor split mode on Qwen-3.6-27b with dual RTX 3090s. Tensor split mode lacks llama_params_fit implementation, causing NCCL crash during model warmup.
Read source
Your take?
LlamaQwenInfrastructureOpen source

Summary generated by Claude — human-verified