# Cord: Confidence-Anchored Order Residual Decoding for Masked Diffusion Language Models

**Authors:** Chengwei Zhou, Zhaoyan Jia, Massoud Pedram, Gourav Datta  
**Lab:** Case Western Reserve University · **Published:** 29 Oct 2026  
**Links:** [arXiv](https://arxiv.org/abs/2610.39372) · [PDF](https://arxiv.org/pdf/2610.39372) · [This page](https://omen-bit.github.io/ai-paper-daily/paper/2610.39372.html)

## Key numbers

- **32.0%**: Cord improves average task success from 32.0% under confidence decoding to 48.2%
- **48.2%**: Cord improves average task success from 32.0% under confidence decoding to 48.2%
- **5.39%**: and incurs only 5.39% inference latency overhead

## Abstract

The decoding order of masked diffusion language models (dLLMs) can substantially affect generation quality, yet common decoders typically apply the same reveal rule throughout generation. Confidence provides a strong default, but it measures how decisively a position can be predicted now, not how useful revealing that position will be for subsequent decoding. We propose Cord, a lightweight prompt-conditioned policy that retains confidence decoding as a stable reference and learns when and how to depart from it through geometric residuals over generation direction, proximity to revealed context, and two-sided infilling. The residuals adapt to both the prompt and the evolving partial response. Rather than sampling a new policy action at every decoding step, Cord samples a single low-dimensional coefficient matrix per rollout, which induces an entire state-dependent reveal trajectory. This yields a contextual-bandit formulation trained directly from sequence-level rewards, without step-level credit assignment or backbone updates. Across three dLLMs and five reasoning, code, and constraint-satisfaction benchmarks, Cord improves average task success from 32.0% under confidence decoding to 48.2%, and further improves over the best per-domain fixed residual. Behavioral audits show that the learned residuals induce substantial, task-dependent changes in reveal locality and two-sided infilling. Cord adds only $0.53$M trainable parameters, requires no additional backbone forward passes, and incurs only 5.39% inference latency overhead.

---

Notes written by AI from the paper, numbers copied from the abstract. Check the paper before you rely on them. From AI Papers Daily.
