Radhika Gaonkar

Exploring Low-Cost Transformer Model Compression for Large-Scale Commercial Reply Suggestions

2021 · arXiv (Cornell University)

Fine-tuning pre-trained language models improves the quality of commercial reply suggestion systems, but at the cost of unsustainable training times. Popular training time reduction approaches are resource intensive, thus we explore low-cost model compression techniques …