PQR: A Framework to Generate Diverse and Realistic User Queries that Elicit QA Agent Failures

In three linesPQR is a framework that automatically generates realistic user queries to identify failures in LLM-based QA agents. Through iterative interaction between query refinement and prompt refinement modules, PQR uncovers 23-78% more unhelpful responses than prior methods, with more diverse and realistic queries.

Summary generated by Claude — human-verified