AUG 12, 2026 · PREPRINT
Towards Understanding On-Policy Distillation through the Lens of Test-Time Scaling
arXiv
This is a computational analysis using existing models to examine mechanisms underlying on-policy distillation; it raises questions about the interpretation of OPD rather than providing empirical evidence of clinical or practical utility.
Study details
DesignComputational model evaluation study
InterventionOn-policy distillation (OPD) training on st…
ComparatorPre-OPD base models, evaluated at varying s…