preprint Open access

CGRN: Conflict-Aware Geometric Routing Network for Multimodal Sentiment Analysis

  • Zenodo (CERN European Organization for Nuclear Research)
  • European Organization for Nuclear Research
Research footprint

At a glance

Citations
0
References
0
Comments
0
Paper overview

Öz

Multimodal sentiment analysis over text-image pairsis challenged by cross-modal conflict, where textual and visualcues express contradictory sentiment (e.g., sarcasm andirony). Most existing systems apply uniform fusion regardlessof modality agreement, leading to suboptimal performance ondifficult, contradictory samples. We present Conflict-Aware GeometricRouting Network (CGRN), a modular architecture thatcomputes a differentiable Geometric Dissonance Score (GDS)and conditionally routes each sample to either a normal fusionbranch (for low dissonance) or a conflict-specialized branch withcross-modal attention and optional sarcasm auxiliary supervision(for high dissonance). The routing threshold τ is learnable andtrained with margin-based hinge separation on conflict vs. nonconflictGDS distributions. Routing is soft and differentiableduring training, allowing gradient flow through the controller,and hard at inference for efficiency and interpretability. CGRNadditionally generates structured per-inference Conflict Reportsgrounded in geometric and routing internals, providing explicitmechanism-level traceability. On the challenging MVSA-Multipledataset containing 19,600 text-image posts, CGRN reaches 61.8%accuracy and 0.552 macro-F1, with 78.1% of conflict samplescorrectly routed to the conflict branch, achieving a 0.483 conflictsubsetF1 score. Comprehensive ablation studies demonstrate thatboth magnitude and directional divergence are critical for reliable conflict identification. The RoBERTa-based variant has 126.9Mparameters and maintains a lightweight inference profile. Codeand artifacts are made available to promote further research ingeometrically constrained multimodal routing.Index Terms—multimodal sentiment analysis, cross-modal conflict,geometric dissonance, conditional routing, sarcasm detection,explainability, transformer networks

Record transparency

Publication details

DOI
10.5281/zenodo.19693575
OpenAlex
W7155165829
Document type
preprint
Language
EN
Source
Zenodo (CERN European Organization for Nuclear Research)
Last metadata update
Community

Comments

Oturum Açın to join the discussion.

  1. No comments yet. Start the discussion.