Ida Momennejad

Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models

2023 · arXiv (Cornell University)

Large language models (LLMs) exhibit remarkable performance improvement through in-context learning (ICL) by leveraging task-specific examples in the input. However, the mechanisms behind this improvement remain elusive. In this work, we investigate how LLM embeddings …