Weak Critics Make Strong Learners: On-Policy Critique Distillation for Scalable Oversight

In three linesOPCD method to improve large models using weak critics. Instead of weak supervisors as labelers, they guide revisions. Progressive on-policy critique distillation filters high-quality critiques and distills critic-guided behavior into strong models via adaptive self-teacher signals. Results on reasoning and alignment benchmarks.

Summary generated by Claude — human-verified