Junting Zhou

Quantification of Large Language Model Distillation

2025 · arXiv (Cornell University)

Model distillation is a fundamental technique in building large language models (LLMs), transferring knowledge from a teacher model to a student model. However, distillation can lead to model homogenization, reducing diversity among models and impairing …

SciDA: Scientific Dynamic Assessor of LLMs

2025 · arXiv (Cornell University)

Advancement in Large Language Models (LLMs) reasoning capabilities enables them to solve scientific problems with enhanced efficacy. Thereby, a high-quality benchmark for comprehensive and appropriate assessment holds significance, while existing ones either confront the risk …