Xin Guo

RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models

2021 · arXiv (Cornell University)

Pre-trained language models achieve outstanding performance in NLP tasks. Various knowledge distillation methods have been proposed to reduce the heavy computation and storage requirements of pre-trained language models. However, from our observations, student models acquired …

Enhancing the Skin Disease Classification Accuracy base on Weighted Cross-Entropy Method with ISIC Dataset

2024

Early detection of skin diseases is essential for improving patient survival rates and preventing serious harm to people's lives and health. In recent years, there have been advancements in the field of skin disease identification …