Smith, Kazimier

Feeding LLM Annotations to BERT Classifiers at Your Own Risk

2025 · arXiv (Cornell University)

Using LLM-generated labels to fine-tune smaller encoder-only models for text classification has gained popularity in various settings. While this approach may be justified in simple and low-stakes applications, we conduct empirical analysis to demonstrate how …