Michael McCabe

xVal: A Continuous Numerical Tokenization for Scientific Language Models

2023 · arXiv (Cornell University)

Due in part to their discontinuous and discrete default encodings for numbers, Large Language Models (LLMs) have not yet been commonly used to process numerically-dense scientific datasets. Rendering datasets as text, however, could help aggregate …