Hamid Palangi

MMMT-IF: A Challenging Multimodal Multi-Turn Instruction Following Benchmark

2024 · ArXiv.org

Evaluating instruction following capabilities for multimodal, multi-turn dialogue is challenging. With potentially multiple instructions in the input model context, the task is time-consuming for human raters and we show LLM based judges are biased towards …