pith. sign in

arxiv: 2503.14863 · v1 · pith:W7YAMRVI · submitted 2025-03-19 · cs.CV

Temporal-Consistent Video Restoration with Pre-trained Diffusion Models

Hengkang Wang , Yang Liu , Huidong Liu , Chien-Chih Wang , Yanhui Guo , Hongdong Li , Bryan Wang , Ju Sun This is my paper

pith:W7YAMRVIopen to challenge →

classification cs.CV
keywords consistencyvideodiffusiontemporalapproximationerrorsmodelspre-trained
0
0 comments X
read the original abstract

Video restoration (VR) aims to recover high-quality videos from degraded ones. Although recent zero-shot VR methods using pre-trained diffusion models (DMs) show good promise, they suffer from approximation errors during reverse diffusion and insufficient temporal consistency. Moreover, dealing with 3D video data, VR is inherently computationally intensive. In this paper, we advocate viewing the reverse process in DMs as a function and present a novel Maximum a Posterior (MAP) framework that directly parameterizes video frames in the seed space of DMs, eliminating approximation errors. We also introduce strategies to promote bilevel temporal consistency: semantic consistency by leveraging clustering structures in the seed space, and pixel-level consistency by progressive warping with optical flow refinements. Extensive experiments on multiple virtual reality tasks demonstrate superior visual quality and temporal consistency achieved by our method compared to the state-of-the-art.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion

    cs.CV 2025-12 conditional novelty 7.0

    Stream-DiffVSR enables practical low-latency video super-resolution by combining a four-step distilled denoiser, auto-regressive temporal guidance, and a temporal processor in a strictly causal pipeline.

  2. Saving Foundation Flow-Matching Priors for Inverse Problems

    cs.LG 2025-11 unverdicted novelty 6.0

    FMPlug adapts foundation flow-matching models into practical priors for inverse problems by combining instance-guided warm-start with sharp Gaussianity regularization, showing superior results on image restoration and...

  3. TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration

    cs.CV 2026-06 unverdicted novelty 5.0

    TIGER is a tri-prior fusion method for face video restoration using identity, geometry, and generative priors with progressive training to achieve SOTA identity fidelity and temporal stability on a new large-scale dataset.

  4. TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration

    cs.CV 2026-06 unverdicted novelty 4.0

    TIGER fuses identity embeddings, disentangled 3D geometry parameters, and one-step generative priors with three-stage training to achieve claimed state-of-the-art identity fidelity and temporal stability in face video...