Restoring the Sweet Spot: Pass-Rate Weighted Self-Distillation for LLM Reasoning

In three linesSC-SDPO improves LLM self-distillation by weighting losses with √[p(1-p)], creating an implicit curriculum. Experiments on Qwen3-8B (+3.2/+4.3 mean@16/maj@16) and OLMo-3-7B (+1.8/+3.0) show stable gains with zero computational overhead.

Summary generated by Claude — human-verified