Santu Karmaker

Revisiting Word Embeddings in the LLM Era

2025 · arXiv (Cornell University)

Large Language Models (LLMs) have recently shown remarkable advancement in various NLP tasks. As such, a popular trend has emerged lately where NLP researchers extract word/sentence/document embeddings from these large decoder-only models and use them …