Researchers propose using general instructions as privileges in On-Policy Context Distillation (OPCD) to improve out-of-distribution (OOD) performance and maintain in-domain performance. Experimental results on various datasets and models show that matched instruction privileges outperform gold privileges in OOD accuracy.