Punit Singh Koura

Analysing Off-The-Shelf Options for Question Answering with Portuguese FAQs

2022 · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)

Following the current interest in developing automatic question answering systems, we analyse alternative approaches for finding suitable answers from a list of Frequently Asked Questions (FAQs), in Portuguese. These rely on different technologies, some more …

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

2022 · arXiv (Cornell University)

Recent work has shown that fine-tuning large pre-trained language models on a collection of tasks described via instructions, a.k.a. instruction-tuning, improves their zero and few-shot generalization to unseen tasks. However, there is a limited understanding …

Llama 2: Open Foundation and Fine-Tuned Chat Models

2023 · arXiv (Cornell University)

In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama 2-Chat, …