LLMs & Models4 min read
LLM distillation
LLM distillation stalls when context goes static. Flux-OPD makes it evolve
Contexts can carry task preferences into LLM training, but once distilled into a student they add little supervision. Peking University's Flux-OPD keeps the context moving with the student and uses a conflict term to weight teacher corrections. The abstract reports gains over existing OPD paradigms without naming numbers.
2026-07-31