Alon Jacovi

Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals

2020 · arXiv (Cornell University)

A growing body of work makes use of probing to investigate the working of neural models, often considered black boxes. Recently, an ongoing debate emerged surrounding the limitations of the probing paradigm. In this work, …

Neighboring Words Affect Human Interpretation of Saliency Explanations

2023 · arXiv (Cornell University)

Word-level saliency explanations ("heat maps over words") are often used to communicate feature-attribution in text-based models. Recent studies found that superficial factors such as word length can distort human interpretation of the communicated saliency scores. …