QQJ: Quantifying Qualitative Judgment for Scalable and Human-Aligned Evaluation of Generative AI

In three linesQQJ is an evaluation framework for generative AI that combines human judgment and LLMs. It uses expert-designed multi-dimensional rubrics and calibrates LLM evaluators on a small high-quality annotation set. Experiments on text and image generation show stronger alignment with human judgment than traditional automatic metrics and unconstrained LLM evaluators.

Summary generated by Claude — human-verified