Xin Zhao

A Multi-Layered Block Chain Network for Individual-Oriented Health-Care Records Storage and Management

2019

In the background of the existing medical system, the medical information of most medical institutions in China is not Shared, which leads to individual health records scattered in different medical institutions so that it is …

Federated Fingerprint Learning with Heterogeneous Architectures

2022 · 2022 IEEE International Conference on Data Mining (ICDM)

Recent studies on federated learning (FL) have sought to solve the system heterogeneity issue by designing customized local models for different clients. However, public dataset introduction, sensitive information exchange, non-trivial computational cost, or particular architecture …

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models

2024 · arXiv (Cornell University)

Large language models (LLMs) demonstrate remarkable multilingual capabilities without being pre-trained on specially curated multilingual parallel corpora. It remains a challenging problem to explain the underlying mechanisms by which LLMs process multilingual texts. In this …

Debiased Contrastive Learning of Unsupervised Sentence Representations

2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart irrelevant …