Arash Eshghi

An Incremental Dialogue System for Learning Visually Grounded Language (demonstration system)

2016 · Edinburgh Napier Research Repository (Edinburgh Napier University)

We present a multi-modal dialogue system for interactive learning of perceptually grounded word meanings from a human tutor. The system integrates an incremental, semantic, and bi-directional grammar framework – Dynamic Syntax and Type Theory with …

Benchmarking Natural Language Understanding Services for building Conversational Agents

2019 · arXiv (Cornell University)

We have recently seen the emergence of several publicly available Natural Language Understanding (NLU) toolkits, which map user utterances to structured, but more abstract, Dialogue Act (DA) or Intent specifications, while making this process accessible …

Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling

2024

This study explores replacing Transformers in Visual Language Models (VLMs) with Mamba, a recent structured state space model (SSM) that demonstrates promising performance in sequence modeling.We test models up to 3B parameters under controlled conditions, …