Shiyun Xu

FlowNIB: An Information Bottleneck Analysis of Bidirectional vs. Unidirectional Language Models

2025 · arXiv (Cornell University)

Bidirectional language models have better context understanding and perform better than unidirectional models on natural language understanding tasks, yet the theoretical reasons behind this advantage remain unclear. In this work, we investigate this disparity through …