Zhuang Liu

Research on attention memory networks as a model for learning natural language inference

2016

Natural Language Inference (NLI) is a fundamentally important task in natural language processing that has many applications. It is concerned with classifying the logical relation between two sentences. In this paper, we propose attention memory …

One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning

2023 · arXiv (Cornell University)

We present Generalized LoRA (GLoRA), an advanced approach for universal parameter-efficient fine-tuning tasks. Enhancing Low-Rank Adaptation (LoRA), GLoRA employs a generalized prompt module to optimize pre-trained model weights and adjust intermediate activations, providing more flexibility …

Explainable Few-shot Knowledge Tracing

2024 · arXiv (Cornell University)

Knowledge tracing (KT), aiming to mine students' mastery of knowledge by their exercise records and predict their performance on future test questions, is a critical task in educational assessment. While researchers achieved tremendous success with …