All papersReasoning & AgentsPeking University

MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation

/ Paper arXiv 2611.03087

Key numbers

7%…multiple reasoning and perception benchmarks show that MIRA yields an average 7% improvement on in-domain benchmarks

From the paperCopied from the abstract, not written by AI.

Abstract

From the paperThe authors' own words.

While Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced multimodal reasoning, existing frameworks suffer from a critical "perception-reasoning gap." Due to an over-reliance on seemingly relevant visual tokens, even minor perceptual perturbations can propagate through the reasoning process, leading to compounding hallucinations. To address this issue, we propose MIRA, a training framework that improves robustness to erroneous visual contexts while enhancing logical reasoning ability. By injecting filtered, deceptive visual contexts during training, we construct challenging "hard traps" that stress-test the model's robustness to misleading information. Furthermore, we introduce a group-wise reflection-triggering mechanism that enables the model to autonomously detect and rectify inconsistencies between visual cues and logical constraints, which is ultimately internalized as an intrinsic policy behavior. Importantly, MIRA does not rely on human annotations. Experimental results across multiple reasoning and perception benchmarks show that MIRA yields an average 7% improvement on in-domain benchmarks, with consistent improvements on vision-centric benchmarks. These findings highlight that active error recovery is essential for robust multimodal reasoning. Comprehensive ablation studies and analyses further provide insights into why MIRA is effective.

From the full paper

From the paperCopied from the paper itself by our code.

Reading the paper on arXiv…

Where it fits

The most cited papers it builds on, and the papers that build on it.

/ Builds on 3 most cited

  1. 202226k citedTraining language models to follow instructions with human feedback ↗
  2. 202410.9k citedDeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models ↗
  3. 20239.8k citedBLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models ↗

/ Built on by 1 paper cite it

  1. 20260 citedModalSearcher: Weaving Visual Evidence into Autonomous Cross-Modal Deep Search

From Semantic Scholar, updated weekly.

Ask this paper

/ Ask a questionAnswers come from the full paper and name the section

    / Your notes

    Select text in the abstract to highlight it or add a note. They stay in this browser.

      Read the PDF