Jing Yi

Multi-Modal Variational Graph Auto-Encoder for Recommendation Systems

2021 · IEEE Transactions on Multimedia

Graph embedding based methods have been used in recommendation systems recently, owing to their advances in modeling nodes as embeddings in a low-dimensional space. By effective neighborhood aggregation, graph convolutional networks can exploit high-order connections …

Exploring Mode Connectivity for Pre-trained Language Models

2022

Recent years have witnessed the prevalent application of pre-trained language models (PLMs) in NLP. From the perspective of parameter space, PLMs provide generic initialization, starting from which high-performance minima could be found. Although plenty of …

Parameter-efficient fine-tuning of large-scale pre-trained language models

2023 · Nature Machine Intelligence

Abstract With the prevalence of pre-trained language models (PLMs) and the pre-training–fine-tuning paradigm, it has been continuously shown that larger models tend to yield better performance. However, as PLMs scale up, fine-tuning and storing all …