Category: On-Policy Distillation

• What Exactly Is On-Policy Distillation? An In-Depth Interpretation of On-Policy/Self-Distillation