Category: Self-Distillation

• What Exactly Is On-Policy Distillation? An In-Depth Interpretation of On-Policy/Self-Distillation