Zijian Li

An Encoder-Decoder Framework Translating Natural Language to Database Queries

2017 · arXiv (Cornell University)

Machine translation is going through a radical revolution, driven by the explosive development of deep learning techniques using Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN). In this paper, we consider a special case …

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients

2024 · arXiv (Cornell University)

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based algorithms …

FroM: Frobenius Norm-Based Data-Free Adaptive Model Merging

2025 · arXiv (Cornell University)

With the development of large language models, fine-tuning has emerged as an effective method to enhance performance in specific scenarios by injecting domain-specific knowledge. In this context, model merging techniques provide a solution for fusing …