Imanol Schlag

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

2019 · arXiv (Cornell University)

We incorporate Tensor-Product Representations within the Transformer in order to better support the explicit representation of relation structure. Our Tensor-Product Transformer (TP-Transformer) sets a new state of the art on the recently-introduced Mathematics Dataset containing …

Solving Quantitative Reasoning Problems with Language Models

2022 · arXiv (Cornell University)

Language models have achieved remarkable performance on a wide range of tasks that require natural language understanding. Nevertheless, state-of-the-art models have generally struggled with tasks that require quantitative reasoning, such as solving mathematics, science, and …