Huanxuan Liao

Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks

2025 · Proceedings of the AAAI Conference on Artificial Intelligence

In this paper, we propose Neural-Symbolic Collaborative Distillation (NesyCD), a novel knowledge distillation method for learning the complex reasoning abilities of Large Language Models (LLMs, e.g., \textgreater 13B). We argue that complex reasoning tasks are …