Kai Nylund

Time is Encoded in the Weights of Finetuned Language Models

2024

We present time vectors, a simple tool to customize language models to new time periods.Time vectors are created by finetuning a language model on data from a single time (e.g., a year or month), and …