Rui Hou

Venice: Exploring server architectures for effective resource sharing

2016

Consolidated server racks are quickly becoming the backbone of IT infrastructure for science, engineering, and business, alike. These servers are still largely built and organized as when they were distributed, individual entities. Given that many …

Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes

2023 · arXiv (Cornell University)

Many real-world applications require making multiple predictions from the same text. Fine-tuning a large pre-trained language model for each downstream task causes computational burdens in the inference time due to several times of forward passes. …

Co-training and Co-distillation for Quality Improvement and Compression of Language Models

2023 · arXiv (Cornell University)

Knowledge Distillation (KD) compresses computationally expensive pre-trained language models (PLMs) by transferring their knowledge to smaller models, allowing their use in resource-constrained or real-time settings. However, most smaller models fail to surpass the performance of …

Llama 2: Open Foundation and Fine-Tuned Chat Models

2023 · arXiv (Cornell University)

In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama 2-Chat, …