D K Thennal

Large Language Models Are Overparameterized Text Encoders

2024 · arXiv (Cornell University)

Large language models (LLMs) demonstrate strong performance as text embedding models when finetuned with supervised contrastive training. However, their large size balloons inference time and memory requirements. In this paper, we show that by pruning …