Eduard Klyshinsky

On Dependence of Bert Embeddings on the Syntactic Structure of a Sentence

2023

Experiments demonstrate that Bert embeddings are reflecting syntactic structure of a sentence. In this paper we conduct some experiments demonstrating dependency between cosine similarity of Bert embeddings and position of neighbouring words with consideration of …