Sheng Lu

Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification

2023 · arXiv (Cornell University)

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of LLMs such as the …

DIAA: A Decoding-Efficient Inference Acceleration Approach for On-Device Large Language Models

2026 · Proceedings of the AAAI Conference on Artificial Intelligence

Large Language Models (LLMs) have revolutionized intelligent interactions, enabling mobile applications such as personal assistants on edge devices for local execution. Speculative decoding (SD) has emerged as a promising paradigm to accelerate LLM inference without …