Xiaoyue Lu

Promises and perils of using Transformer-based models for SE research

2024 · Neural Networks

Many Transformer-based pre-trained models for code have been developed and applied to code-related tasks. In this paper, we analyze 519 papers published on this topic during 2017-2023, examine the suitability of model architectures for different …