Masataka Sawayama

Stick to your Role! Stability of Personal Values Expressed in Large Language Models

2024

Standard Large Language Models (LLMs) evaluation contains many different queries from similar minimal contexts (e.g. multiple choice questions). Conclusions from such evaluations are little informative about models' behavior in different new contexts (e.g. in deployment). …