Anand Pillay

Tighter Bounds on the Expressivity of Transformer Encoders

2023 · arXiv (Cornell University)

Characterizing neural networks in terms of better-understood formal systems has the potential to yield new insights into the power and limitations of these networks. Doing so for transformers remains an active area of research. Bhattamishra …