Dhruba Ghosh

Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level

2021

Larger language models have higher accuracy on average, but are they better on every single instance (datapoint)? Some work suggests larger models have higher out-ofdistribution robustness, while other work suggests they have lower accuracy on …