Shleifer, Sam

HuggingFace's Transformers: State-of-the-art Natural Language Processing

2019 · arXiv (Cornell University)

Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has made it possible to effectively utilize this …