Marc de Kamps

Syntactic Knowledge via Graph Attention with BERT in Machine Translation

2023 · arXiv (Cornell University)

Although the Transformer model can effectively acquire context features via a self-attention mechanism, deeper syntactic knowledge is still not effectively modeled. To alleviate the above problem, we propose Syntactic knowledge via Graph attention with BERT …