MATSA: Multi-Agent Table Structure Attribution
At a glance
- Citations
- 3
- References
- 0
- Comments
- 0
Abstract
Large Language Models (LLMs) have significantly advanced QA tasks through in-context learning but often suffer from hallucinations.Attributing supporting evidence grounded in source documents has been explored for unstructured text in the past.However, tabular data present unique challenges for attribution due to ambiguities (e.g., abbreviations, domainspecific terms), complex header hierarchies, and the difficulty in interpreting individual table cells without row and column context.We introduce a new task, Fine-grained Structured Table Attribution (FAST-Tab), to generate row and column-level attributions supporting LLMgenerated answers.We present MATSA 1 , a novel LLM-based Multi-Agent system capable of post-hoc Table Structure Attribution to help users visually interpret factual claims derived from tables.MATSA augments tabular entities with descriptive context about structure, metadata, and numerical trends to semantically retrieve relevant rows and columns corresponding to facts in an answer.Additionally, we propose TabCite, a diverse benchmark designed to evaluate the FAST-Tab task on tables with complex layouts sourced from Wikipedia and business PDF documents.Extensive experiments demonstrate that MATSA significantly outperforms SOTA baselines on TabCite, achieving an 8-13% improvement in F1 score.Qualitative user studies show that MATSA helps increase user trust in Generative AI by providing enhanced explainability for LLM-assisted table QA and enables professionals to be more productive by saving time on fact-checking LLMgenerated answers.
Publication details
- DOI
- 10.18653/v1/2024.emnlp-demo.26
- OpenAlex
- W4404783844
- Document type
- conference-paper
- Language
- EN
- Last metadata update
Comments
Log in to join the discussion.