MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
Paper • 2606.30406 • Published • 26
Distillation
-
-
TurnOPD: Making On-Policy Distillation Turn-Aware for Efficient Long-Horizon Agent Training
Paper • 2607.05804 • Published • 20 -
Trust Region Policy Distillation
Paper • 2607.04751 • Published • 33 -
SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
Paper • 2607.14777 • Published • 105 -
ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation
Paper • 2607.13124 • Published • 15 -
Visual Contrastive Self-Distillation
Paper • 2607.21556 • Published • 50 -
From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Search
Paper • 2607.24280 • Published • 84 -
Pass the Baton: Trajectory-Relayed On-Policy Distillation
Paper • 2607.26057 • Published • 32 -
Enhancing Rubric-based RL via Self-Distillation
Paper • 2607.18082 • Published • 25 -
AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning
Paper • 2608.05987 • Published • 103 -
Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
Paper • 2608.07169 • Published • 49 -
SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation
Paper • 2608.04419 • Published • 29 -
Self-Supervised Visual On-Policy Distillation
Paper • 2608.14144 • Published • 125 -
Latent On-Policy Self-Distillation
Paper • 2608.13040 • Published • 26 -
SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning
Paper • 2608.14277 • Published • 36 -
D^3-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation
Paper • 2608.24987 • Published • 28 -
Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement
Paper • 2608.31046 • Published • 97 -
Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
Paper • 2609.02749 • Published • 407 -
Rethinking On-Policy Distillation of Large Language Models II: One Training Example
Paper • 2609.04172 • Published • 104 -
Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation
Paper • 2609.02998 • Published • 17 -
Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
Paper • 2609.08798 • Published • 82 -
Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation
Paper • 2609.35347 • Published • 180 -
On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics
Paper • 2609.35259 • Published • 201 -
Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresight
Paper • 2610.08077 • Published • 139