FYI llamacpp server can hot swap models now-a-days in under 30sec

In three linesllama.cpp now supports model hot-swapping in under 30 seconds with a clean API that works with OpenWebUI and Hermes. The operation has become significantly faster compared to a few months ago.

Summary generated by Claude — human-verified