Diffusion in prod: how are you handling spiky GPU load and cold starts?

In three linesProduction challenges with diffusion models: handling GPU load spikes, cold starts, and inference costs. Scaling from 100 to 10k requests exposes architectural issues and multi-tenancy problems.

Summary generated by Claude — human-verified