Julia Kiseleva

Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

2021 · arXiv (Cornell University)

Enabling open-domain dialogue systems to ask clarifying questions when appropriate is an important direction for improving the quality of the system response. Namely, for cases when a user request is not specific enough for a …

Where to Go on Your Next Trip?

2015

Recommendation based on user preferences is a common task for e-commerce websites. New recommendation algorithms are often evaluated by offline comparison to baseline algorithms such as recommending random or the most popular items. Here, we …

ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation

2025 · arXiv (Cornell University)

We present ExCyTIn-Bench, the first benchmark to Evaluate an LLM agent X on the task of Cyber Threat Investigation through security questions derived from investigation graphs. Real-world security analysts must sift through a large number …

Understanding User Satisfaction with Intelligent Assistants

2016

Voice-controlled intelligent personal assistants, such as Cortana, Google Now, Siri and Alexa, are increasingly becoming a part of users' daily lives, especially on mobile devices. They introduce a significant change in information access, not only …