Soumyasundar Pal

Plain Transformers Can be Powerful Graph Learners

2025 · arXiv (Cornell University)

Transformers have attained outstanding performance across various modalities, owing to their simple but powerful scaled-dot-product (SDP) attention mechanisms. Researchers have attempted to migrate Transformers to graph learning, but most advanced Graph Transformers (GTs) have strayed …