Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation
On-Policy Self-Distillation (OPSD) improves reasoning by training a student on its own reasoning, using the same model conditioned on reference solutions as a…