"The Whole Is Greater Than the Sum of Its Parts": A Compatibility-Aware Multi-Teacher CoT Distillation Framework

Jan 20, 2026· Jin Cui*, Jiaqi Guo*, Ruixuan Yang, Jiepeng Zhou, Jiayi Lu, Jiajun Xu, Jiangcheng Song, Boran Zhao, Pengju Ren · 1 min read

* Equal contribution

Type
Publication
International Joint Conference on Artificial Intelligence
publications

Overview

Combining complementary teachers through student-aware supervision for more effective reasoning distillation.

Overview of the COMPACT multi-teacher reasoning distillation framework

Accepted to IJCAI 2026. Jin Cui and Jiaqi Guo contributed equally.

Read the paper · Download PDF

Reasoning Distillation Multi-Teacher Learning
Ruixuan Yang
Authors
Ruixuan Yang
Undergraduate Student

I am Ruixuan Yang, an undergraduate in the School of Mathematics and Statistics at Xi’an Jiaotong University (XJTU). I’m interested in Model Efficiency, Multimodal LLMs (MLLMs), Post-training & Reasoning, etc.

I am currently a visiting student in Prof. Yulun Zhang’s group at Shanghai Jiao Tong University and Prof. Huan Wang’s ENCODE Lab at Westlake University.