Derek Lim

Graph Inductive Biases in Transformers without Message Passing

2023 · arXiv (Cornell University)

Transformers for graph data are increasingly widely studied and successful in numerous learning tasks. Graph inductive biases are crucial for Graph Transformers, and previous works incorporate them using message-passing modules and/or positional encodings. However, Graph …