Category: On-Policy Distillation

• Teachers Know the Correct Answer, but Not Necessarily How Students Should Correct Errors: DCE Introduces Dynamic Co-Evolution Distillation
• What Exactly Is On-Policy Distillation? An In-Depth Interpretation of On-Policy/Self-Distillation