SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoning

In three linesSD-Search introduces on-policy hindsight self-distillation for search-augmented reasoning agents. A single model acts as both student and teacher: the teacher, conditioned on past rollout outcomes, guides the student via token-level Jensen-Shannon divergence at query positions. No external teacher model or additional annotations needed.

Summary generated by Claude — human-verified