Everyone here self-hosts inference. Almost nobody self-hosts the tooling around it. That feels backwards to me.

In three linesA r/LocalLLaMA user highlights an inversion: the community self-hosts models (hardest part) but outsources tooling (tracing, evals, monitoring) to SaaS. He argues open-source solutions (Langfuse, ragas, Open WebUI) now enable hosting the full stack locally without external calls.

Summary generated by Claude — human-verified