/ Paper arXiv 2611.06741
Curator's notes
TailSteer adds a final-stage training step that suppresses drift in multi-turn image editing while keeping base model abilities.
TailSteer trains a model to keep images steady when edited many times, so they don't get blurry or change unexpectedly.TailSteer adds a final-stage training step that suppresses drift in multi-turn image editing while keeping base model abilities.TailSteer is a final‑stage fine‑tuning that learns tail‑only preservation corrections from on‑policy rollouts, improving multi‑turn drift resistance in diffusion models.Curator's notesWritten by AI from the paperEvery number here appears in the abstractReport a mistake
What's new
It learns preservation corrections from on-policy rollouts without curated pairs, focusing on the denoising tail rather than altering early dynamics.
Key result
TailSteer reduces cumulative drift over 15‑20 editing turns across FLUX, SenseNova, and Qwen models while preserving base performance.
Why it matters
Builders can create longer interactive editing sessions without the images degrading over successive edits.
Abstract
From the paperThe authors' own words.
Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamicsdenoising dynamicsThe step‑by‑step process a diffusion model uses to remove noise and generate an image. close to those of the base model and concentrate preservation corrections near the trajectory tailtrajectory tailThe later stages of the diffusion denoising process where fine details are refined., where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rolloutson-policy denoising rolloutsGenerated denoising sequences using the current editor model as it would be used at inference time., using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.
From the full paper
From the paperCopied from the paper itself by our code.
Reading the paper on arXiv…
What you could build
Written by AIIntermediateRequires fine‑tuning a diffusion model and generating on‑policy rollouts.
- Create a multi-step image editing web app that maintains visual consistency across many user prompts.
- Develop a plugin for existing diffusion editors that adds TailSteer fine‑tuning for drift‑resistant workflows.
- Build an automated storyboard generator that iteratively refines scenes without losing detail.
Try it
Code, models and demos that use this paper.
- Code:
- ★ 53 on GitHub ↗
- Models:
- Lyricccco/Qwen-Image-2.1-TailSteer ↗4 models on Hugging Face
- Demos:
- fastgpu/vram-and-gpu-cost-calculator ↗5 demos on Hugging Face
- Datasets:
- Lyricccco/Add-and-Preserve ↗2 datasets on Hugging Face
Ask this paper
/ Ask a questionAnswers come from the full paper and name the section
/ Quiz yourself
What part of the denoising process does TailSteer modify to reduce drift?
It concentrates preservation corrections near the trajectory tail, keeping early denoising dynamics close to the base model.
/ Your notes
Select text in the abstract to highlight it or add a note. They stay in this browser.