CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters

In three linesCoLLM unifies federated fine-tuning (FL PEFT) and inference on shared edge GPU clusters. The system coordinates real-time parameter sharing via shadow adapter strategies and dynamically balances workloads to optimize model quality and inference latency. Evaluation shows 3x higher goodput vs existing systems.

Summary generated by Claude — human-verified