Danica J. Sutherland
3 papers in the PaperMetrix corpus
Papers by this author
-
Bias Amplification in Language Model Evolution: An Iterated Learning Perspective
2024 · arXiv (Cornell University)
With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods allow LLMs to generate new examples for …
-
Even Sparser Graph Transformers
2024 · arXiv (Cornell University)
Graph Transformers excel in long-range dependency modeling, but generally require quadratic memory complexity in the number of nodes in an input graph, and hence have trouble scaling to large graphs. Sparse attention variants such as …
-
Token Hidden Reward: Steering Exploration-Exploitation in Group Relative Deep Reinforcement Learning
2025 · arXiv (Cornell University)
Reinforcement learning with verifiable rewards has significantly advanced the reasoning capabilities of large language models, yet how to explicitly steer training toward exploration or exploitation remains an open problem. We introduce Token Hidden Reward (THR), …