Pegah Khayatan

A Concept-Based Explainability Framework for Large Multimodal Models

2024 · arXiv (Cornell University)

Large multimodal models (LMMs) combine unimodal encoders and large language models (LLMs) to perform multimodal tasks. Despite recent advancements towards the interpretability of these models, understanding internal representations of LMMs remains largely a mystery. In …