FactoryLLM: A Safe and Open-Source AI Playground for Evaluating LLMs in Smart Factories

In three linesFactoryLLM is an open-source playground to evaluate LLM-based RAG models for fault diagnostics in smart factories. It analyzes multi-machine documentation with dual evaluation (RAGAS + LLM-as-a-Judge). Case study: 3 LLMs tested on 30 maintenance queries achieving groundedness scores > 0.88.

Summary generated by Claude — human-verified