Generating and Refining Dynamic Evaluation Rubrics for LLM-as-a-Judge

In three linesMethod to automatically generate fine-grained evaluation rubrics without human annotation, tested on four benchmarks. Training-free approach, then iterative fine-tuning via meta-judge reward signals. A fine-tuned 14B rubric generator outperforms larger proprietary models.

Summary generated by Claude — human-verified