llama-server router: a model pinned to one GPU still grabs a CUDA context on every card, so it OOMs when my others are full. Am I missing a flag or is this just how it is?

In three linesUser reports llama-server router mode allocates CUDA context on all GPUs even when a model is pinned to one. Gemma 4B on RTX 5060 Ti reserves ~256 MiB per 3090 and ~120 on 4060 Ti, causing OOM when 3090s are saturated. Issue stems from child processes inheriting router env without per-model `CUDA_VISIBLE_DEVICES` support.

Summary generated by Claude — human-verified