Ziyi Yang

A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations

2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

Language agnostic and semantic-language information isolation is an emerging research direction for multilingual representations models. We explore this problem from a novel angle of geometric algebra and semantic space. A simple but highly effective method …

APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning

2023

Soumya Sanyal, Yichong Xu, Shuohang Wang, Ziyi Yang, Reid Pryzant, Wenhao Yu, Chenguang Zhu, Xiang Ren. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.

Phi-3 Safety Post-Training: Aligning Language Models with a "Break-Fix" Cycle

2024 · arXiv (Cornell University)

Recent innovations in language model training have demonstrated that it is possible to create highly performant models that are small enough to run on a smartphone. As these models are deployed in an increasing number …