vllm-doctor — a CLI tool to diagnose and monitor vLLM inference servers

In three linesvllm-doctor is an open-source CLI tool that diagnoses vLLM inference servers by analyzing Prometheus metrics. It detects queue pressure, high TTFT/TPOT latencies, KV cache saturation, and provides recommendations with confidence levels.

Summary generated by Claude — human-verified