Roland Fernandez

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

2019 · arXiv (Cornell University)

We incorporate Tensor-Product Representations within the Transformer in order to better support the explicit representation of relation structure. Our Tensor-Product Transformer (TP-Transformer) sets a new state of the art on the recently-introduced Mathematics Dataset containing …