Pascal Welke

Hidden Schema Networks

2022 · arXiv (Cornell University)

Large, pretrained language models infer powerful representations that encode rich semantic and syntactic content, albeit implicitly. In this work we introduce a novel neural language model that enforces, via inductive biases, explicit relational structures which …