Honghao Lin

Even Sparser Graph Transformers

2024 · arXiv (Cornell University)

Graph Transformers excel in long-range dependency modeling, but generally require quadratic memory complexity in the number of nodes in an input graph, and hence have trouble scaling to large graphs. Sparse attention variants such as …