All papersGenerative AI & DiffusionRoblox Corporation

Back to Pixels: Lifting Latent Video Diffusion into Pixel Space

/ Paper arXiv 2611.17336

Key numbers

2×it generates at 2× higher resolution with the same per-frame token count

From the paperCopied from the abstract, not written by AI.

Why this ranked

MeasuredPublic numbers, not AIHow ranking works

7 / 100#134 of 1200 papers that day, from GitHub, Hugging Face, Hacker News and Semantic Scholar, looked up the morning it was ranked.

Builder evidence0 / 40

  • No public code found

Community attention4.8 / 30

  • ▲ 2 upvotes on Hugging Face

Author track record2.5 / 15

  • From Roblox Corporation

What the paper shows0 / 15

  • Nothing found

Abstract

From the paperThe authors' own words.

Frontier video generation models work in a VAE latent space that compresses video in both space and time. This compression made training tractable, but now limits high-resolution, controllable, and interactive generation -- doubling resolution quadruples token count, conditions apply to groups of frames rather than individual ones, and each response must wait for the rest of its multi-frame block. We present PixVid, a simple yet effective method that lifts a pretrained latent video model to directly generate every frame in pixel space. PixVid keeps the diffusion transformer and replaces the VAE decoder with a convolutional head that renders its outputs into pixels. We find that predicting clean video rather than velocity, together with a larger noise shift, is key to quality. Finetuned from Wan2.1-14B, PixVid is competitive with the latent baseline within ~ 1.3M training clips. Working framewise in pixels, it generates at 2× higher resolution with the same per-frame token count, keeps depth-conditioned video editing aligned under fast motion, and responds to each action at the next frame. Project page: https://chenshuo20.github.io/PixVid/

From the full paper

From the paperCopied from the paper itself by our code.

Reading the paper on arXiv…

Ask this paper

/ Ask a questionAnswers come from the full paper and name the section

    / Your notes

    Select text in the abstract to highlight it or add a note. They stay in this browser.

      Read the PDF