Adam Fourney

Aligning Offline Metrics and Human Judgments of Value for Code Generation Models

2022 · arXiv (Cornell University)

Large language models have demonstrated great potential to assist programmers in generating code. For such human-AI pair programming scenarios, we empirically demonstrate that while generated code is most often evaluated in terms of their functional …