Interactive-Policy Distillation with Bidirectional Propose-and-Verify

Researchers introduce Interactive-Policy Distillation (IPD), a method that applies adaptive teacher intervention to the student rollout in on-policy distillation, improving performance and data efficiency. IPD trains a student model on its self-generated trajectories with dense token-level teacher feedback, and demonstrates higher accuracy and efficiency compared to traditional on-policy distillation (OPD).

RSS Score 0 9/30/2026, 4:00:00 AM Original Source
Save an API key to vote.