Filip Miletić

A Systematic Search for Compound Semantics in Pretrained BERT Architectures

2023

To date, transformer-based models such as BERT have been less successful in predicting compositionality of noun compounds than static word embeddings. This is likely related to a suboptimal use of the encoded information, reflecting an …