Pith. sign in

REVIEW 5 major objections 7 minor 1 cited by

Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolution

T0 review · 5 major / 7 minor · reviewed 2026-08-08 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A diffusion model fine-tuned for compressed video claims the best perceptual quality scores across all tested compression levels and datasets.

desk verdict A reasonable diffusion-based compressed VSR system whose own tables contradict its 'comprehensively outperforms' claim; the ablations are solid, the headline is not. read the letter →

arxiv 2502.07381 v3 pith:34NMKAOH submitted 2025-02-11 cs.CV

Hongyu An , Xinfeng Zhang , Shijie Zhao , Li Zhang , Ruiqin Xiong This is my paper · ORCID
classification cs.CV
keywords videosuper-resolutioncompresseddiffusionmodellatentcompression-awarepromptstemporalconsistencyopticalflowperceptualquality
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that a latent diffusion model, originally trained for generic image synthesis, can be adapted into the state of the art for compressed video super-resolution by explicitly handling two failure modes: compression-induced spatial distortions and temporal flicker. The proposed SDATC model cleans and up-scales the low-quality input before conditioning the diffusion process, injects compression-level information through learned prompts, and enforces temporal coherence with spatio-temporal attention plus optical-flow alignment. Over three benchmark datasets (REDS4, Vid4, UDM10) at three H.264 compression levels, the authors report consistent wins on perceptual metrics (LPIPS, DISTS, FID, NIQE, MANIQA, CLIP-IQA) and in a pairwise user study, at lower inference cost than competing diffusion video super-resolution models. The practical importance is that internet and mobile videos are both downscaled and compressed, and ordinary super-resolution methods tend to amplify compression artifacts rather than remove them.

What carries the argument

The load-bearing mechanism is a set of three inserted modules on a frozen latent diffusion backbone: DCM (a Swin-Transformer-based preprocessor with RSTB blocks and PixelShuffle that upscales and de-noises the low-quality frame before VAE encoding, producing a cleaner conditioning signal), CAPM (an auxiliary CNN plus adaptive average pooling that turns latent features into a compression-aware weighting vector modulating learned prompt tokens, inserted at every UNet and VAE decoder resolution), and STAM (3D convolutions plus temporal self-attention in the VAE decoder with learnable balance factors, complemented by optical-flow-based warping gradients computed with RAFT during each denoising step). The argument is that DCM shortens the LPIPS/FID distance between the generated distribution and ground truth, CAPM reduces compression artifacts as measured by perception-sensitive pixel loss, and STAM raises VMAF and smooths temporal profiles.

What would settle it

Run SDATC on videos compressed with HEVC or AV1 at bit rates outside the 10K-100K training range and compare perceptual metrics (LPIPS, MANIQA, CLIP-IQA) against the same baselines; if the reported gains disappear or reverse on out-of-distribution compression, the central compression-awareness claim fails.

Watch

Extended reading notes

Core claim

The central claim is that a pretrained Stable Diffusion v2.1 latent diffusion model, fine-tuned with three added modules, outperforms existing generative and non-generative video super-resolution methods in perceptual quality when the input is a compressed, low-resolution video. The distortion control module (DCM) uses Swin Transformer blocks and pixel-shuffle upsampling to remove compression noise and produce a cleaner conditioning latent. The compression-aware prompt module (CAPM) extracts compression-specific features via an auxiliary convolutional network and adaptive pooling, then uses them to weight prompt tokens inserted into every stage of both the UNet and VAE decoders, letting the sampling adapt to different compression intensities. The spatio-temporal attention module (STAM) adds 3D convolutions and temporal self-attention inside the VAE decoder, and during each denoising step optical flow from RAFT computes a warping-consistency error whose gradient nudges the latent toward temporal smoothness. On REDS4, Vid4, and UDM10 with CRF values 15, 25, and 35, SDATC achieves the best or second-best LPIPS, DISTS, FID, NIQE, MANIQA, and CLIP-IQA, and a user study reports that volunteers prefer SDATC output over four competing methods on most test videos.

Load-bearing premise

The method assumes that x264 compression at random bit rates from 10K to 100K during training is representative of all compression encountered at test time, so that the learned distortion-cleaning and compression-aware prompts generalize to other codecs and bit rates.

Editorial extensions

If this is right

  • If the claim holds, SDATC becomes the new reference point for perceptual quality in compressed video super-resolution, beating both regression-based VSR and prior diffusion-based VSR on no-reference and perceptual-reference metrics.
  • The modular design implies that other latent diffusion restoration models could be adapted to compressed video by appending a distortion-cleaning input stage and compression-conditioned prompts, without retraining the full diffusion backbone.
  • The optical-flow gradient update during sampling offers a generic recipe for stabilizing diffusion-based video generation and restoration, which could transfer to other multi-frame generative tasks.
  • The consistent gap between perceptual metrics and PSNR/SSIM reinforces the known fidelity-perception trade-off in generative restoration, now demonstrated specifically for compressed video.
  • Because CAPM encodes compression intensity into prompts, the method opens a path toward controllable restoration where a user or a rate-control system specifies the target compression level to adjust the strength of detail regeneration.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper evaluates only H.264/x264 with CRF 15, 25, and 35, while training uses bit rates 10K-100K, so the strongest natural test is cross-codec generalization: applying SDATC to HEVC or AV1 compressed videos at bit rates outside that range would reveal whether the compression-aware prompts truly generalize or merely memorize the training codec.
  • The ablation evidence suggests DCM alone accounts for the largest perceptual gains (LPIPS from 0.1551 to 0.1005), so a reasonable editorial conjecture is that much of SDATC's advantage comes from the input-cleaning stage rather than from the prompt or temporal modules; isolating DCM against a generic pretrained denoiser would settle this.
  • Temporal consistency is measured through VMAF and visual profile comparisons; a quantitative flicker metric, such as per-pixel temporal variance or a frame-interpolation consistency check, would sharpen the claim of smooth output videos.
  • At 50 sampling steps and about 11.6 seconds per frame on an A100, SDATC is not real-time, so the practical deployment would require distillation or a reduced-step sampler; the perceptual advantage at fewer steps is not explored.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 7 minor

Summary. The paper proposes SDATC, a diffusion-based compressed video super-resolution method built on Stable Diffusion v2.1, and attributes its gains to three components: a distortion control module (DCM) that modulates low-quality inputs, a compression-aware prompt module (CAPM) that estimates degradation-level prompts, and a spatio-temporal attention module (STAM) combined with optical-flow-based latent warping for temporal consistency. The method is trained end-to-end on x264-compressed REDS videos and evaluated at CRFs 15, 25, and 35 on REDS4, Vid4, and UDM10. The central claim is that SDATC comprehensively outperforms prior methods on LPIPS, DISTS, FID, NIQE, MANIQA, and CLIP-IQA across these datasets and compression levels.

Significance. If the strongest results hold, the paper is a useful demonstration that compression-aware conditioning and temporal-consistency mechanisms can make diffusion-based VSR practical for compressed video: it fine-tunes only 135.1M of 1.5B parameters, reports a lower inference time than several diffusion baselines, and provides module-level ablations plus temporal-profile visualizations. The strengths are the end-to-end training on compressed video pairs, the explicitly compression-aware prompt design, and the attempt to address spatial and temporal degradation jointly. However, the headline empirical assertion is not supported by the paper's own tables, the evaluation covers only the x264/CRF degradation family used in training, and the closest diffusion-VSR baselines are missing from the quantitative comparison. With corrected claims and additional robustness evidence, the contribution is potentially publishable.

major comments (5)
  1. [IV-B, Tables I-II] The sentence 'our proposed SDATC comprehensively outperforms other methods in terms of LPIPS, DISTS, FID, NIQE, MANIQA, and CLIP-IQA, at different compression levels on the REDS4, Vid4, and UDM10 datasets' is contradicted by the paper's own tables. Examples include: REDS4 CRF=25 LPIPS 0.3488 (SDATC) vs. 0.3366 (MGLD-VSR); REDS4 CRF=35 FID 113.19 vs. 97.90 (MGLD-VSR) and DISTS 0.1602 vs. 0.1587 (MGLD-VSR); Vid4 CRF=25 FID 92.56 vs. 86.52 (Upscale-A-Video); Vid4 CRF=35 FID 231.08 vs. 138.97 (Upscale-A-Video) and 166.07 (MGLD-VSR); UDM10 CRF=15 FID 38.52 vs. 37.24 (FTVSR) and LPIPS 0.2804 vs. 0.2756 (StableSR); UDM10 CRF=35 LPIPS 0.4278 vs. 0.4149 (MGLD-VSR) and FID 146.33 vs. 117.43 (MGLD-VSR). The one acknowledged exception (CLIP-IQA on REDS4 CRF=15) is not the only exception. The headline should be replaced by a precise statement of the configurations and metrics in which SDATC wins or loses, with counts or per-setting tables rather than a blanket claim.
  2. [IV-A.1, IV-B] The training degradation is x264 compression at bit rates of 10K-100K, and the test degradation is also x264 compression at CRFs 15, 25, and 35. Because the relationship between those CRFs and the training bit-rate range is not quantified, it is unclear whether any test setting is outside the training distribution, and the paper contains no evaluation on other codecs (e.g., HEVC or AV1), other rate-control schemes, or bit rates outside the training range. This weakens the claim that CAPM 'dynamically encodes compression-related information' and adapts to 'different degradation levels'; an out-of-distribution test would be the direct way to support that claim.
  3. [II-C, IV-A.3] The related work discusses StableVSR and SATeCo as diffusion-based VSR methods, but neither is included in the quantitative comparisons in Tables I-III. Since these are among the closest competitors to the proposed approach, the wording 'other methods' and the state-of-the-art assertion are incomplete without them. Please add these baselines with the same evaluation protocol, or explain why they cannot be compared.
  4. [III-D, IV-E, Table VII] Temporal consistency is a central contribution, but the quantitative support is thin: Table VII reports VMAF for a single experiment (REDS4 CRF=25), Fig. 13 provides only visual temporal profiles, and the user study in Section IV-E uses 15 participants with no significance testing or confidence intervals. No error bars or repeated-run statistics are given for any of the perceptual metrics, which is especially important because REDS4 contains only four sequences. Please report VMAF across all datasets and CRFs and provide uncertainty or significance information for the user-study preferences.
  5. [Eq. (13), III-D] The optical-flow-based sampling update in Eq. (13) is not fully specified: the gradient notation does not identify which scalar function is being differentiated, the sign of the gradient term is not justified, and no pseudo-code describes how the flow-based update is interleaved with the DDPM step. Since this update is one of the claimed causes of temporal consistency, please provide the exact objective, the sign convention, and the schedule of the scaling sigma squared.
minor comments (7)
  1. [Abstract/IV-B] There are name typos in the manuscript: 'PACM' appears in the introduction where CAPM is meant, and 'STDAC' appears twice in Section IV-B instead of SDATC.
  2. [Table I] The Vid4 rows labeled 'CA VSR [21]' cite reference [21], but CA VSR is reference [19] (FTVSR is [21]); the citation labels should be corrected throughout the tables and text.
  3. [Eq. (1), Eq. (6), Eq. (12)] Several equations have typesetting problems: Eq. (1) writes the product over alpha as 'Qt', and Eqs. (6) and (12) use index ranges that are garbled in the rendering; please use standard product/summation notation.
  4. [V-C] The last sentence of the temporal-profile paragraph is incomplete, ending with 'SDATC achieves smoother multi-frame reconstruction, .' followed by nothing; it should either be finished or removed.
  5. [References] References [29] and [44] have malformed author information inserted into the title text; these entries need to be regenerated.
  6. [IV-E, Fig. 8] The user study is described only as '15 participants' and '12 videos'; please state the number of pairwise comparisons per participant, the interface, and whether the preference percentages in Fig. 8 are statistically significant.
  7. [General] Please add a statement about code and model availability, since the paper currently provides no link or release plan, which matters for reproducibility of the fine-tuning recipe.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: SDATC is trained end-to-end on paired compressed videos and evaluated on held-out videos, with no equation reducing any prediction to a fitted parameter or self-citation.

full rationale

The paper's derivation chain is self-contained against external benchmarks. The proposed SDATC is trained end-to-end on x264-compressed low-quality/high-quality pairs and evaluated on held-out REDS4, Vid4, and UDM10 sequences under x264 CRFs; no equation reduces a reported prediction to a fitted parameter or to a training-set statistic. DCM, CAPM, STAM, and the optical-flow gradient in Eqs. (4)-(13) are architectural components trained with standard supervised objectives, and CAPM's compression prompts are learned from input features rather than read off test labels. The color correction is an explicit adaIN post-process, not a hidden input disguised as an output. The paper contains no load-bearing self-citation: cited priors such as Stable Diffusion, ControlNet, PromptIR, StableSR, Upscale-A-Video, and MGLD-VSR are external, and no uniqueness theorem is imported from the authors' own prior work. The closest concern is that training and test degradations both come from the x264 codec family with test CRFs near the training bitrate range; that is an out-of-distribution generalization or soundness question, not circularity. Accordingly, the circularity score is zero.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The method introduces no new physical or latent-discrete entities; the DCM, CAPM, and STAM are neural modules, not invented entities. The central claim rests on domain assumptions about the representativeness of x264 compression, the transferability of Stable Diffusion priors, and the accuracy of optical flow on compressed frames. One hyperparameter (omega) is hand-set.

free parameters (1)
  • omega (fidelity weight) = 0.75
    Hand-set scalar in Eq. 11 that balances the VAE encoder features and the generated features in the CFW module. It controls the fidelity vs realism trade-off and is tuned by the authors rather than learned from data.
assumptions (4)
  • domain assumption x264 compression with random bit rates in the training set is representative of compressed video degradation experienced in practice.
    Used in Section IV-A.1 to generate training data; the model is never tested on other codecs or out-of-distribution bitrates.
  • domain assumption The pre-trained Stable Diffusion v2.1 prior provides a useful generative prior for video frames.
    Section III-A states that SDATC applies the pretrained Stable Diffusion v2.1 as its LDM backbone, implying the frozen prior transfers to the VSR task.
  • domain assumption RAFT optical flow estimated on low-quality frames approximates the motion in the high-quality latent space.
    Section III-D, Eq. 12-13: the temporal consistency update warps latent features using flow; if the flow is inaccurate, the gradient update corrupts the latent.
  • standard math Standard DDPM and DDIM sampling equations hold.
    Background Section III-A relies on the well-established DDPM formulation (Eqs. 1-3), which is standard.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolution." pith.science (2026). https://pith.science/paper/34NMKAOH

@misc{pith2026250207381,
  author       = {Pith},
  title        = {Pith review of: Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolution},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/34NMKAOH}},
  note         = {Machine review of arXiv:2502.07381}
}
read the original abstract

Due to storage and bandwidth limitations, videos transmitted over the Internet often exhibit low quality, characterized by low-resolution and compression artifacts. Although video super-resolution (VSR) is an efficient video enhancing technique, existing VSR methods focus less on compressed videos. Consequently, directly applying general VSR approaches fails to improve practical videos with compression artifacts, especially when frames are highly compressed at a low bit rate. The inevitable quantization information loss complicates the reconstruction of texture details. Recently, diffusion models have shown superior performance in low-level visual tasks. Leveraging the high-realism generation capability of diffusion models, we propose a novel method that exploits the priors of pre-trained diffusion models for compressed VSR. To mitigate spatial distortions and refine temporal consistency, we introduce a Spatial Degradation-Aware and Temporal Consistent (SDATC) diffusion model. Specifically, we incorporate a distortion control module (DCM) to modulate diffusion model inputs, thereby minimizing the impact of noise from low-quality frames on the generation stage. Subsequently, the diffusion model performs a denoising process to generate details, guided by a fine-tuned compression-aware prompt module (CAPM) and a spatio-temporal attention module (STAM). CAPM dynamically encodes compression-related information into prompts, enabling the sampling process to adapt to different degradation levels. Meanwhile, STAM extends the spatial attention mechanism into the spatio-temporal dimension, effectively capturing temporal correlations. Additionally, we utilize optical flow-based alignment during each denoising step to enhance the smoothness of output videos. Extensive experimental results on benchmark datasets demonstrate the effectiveness of our proposed modules in restoring compressed videos.

Figures

Figures reproduced from arXiv: 2502.07381 by the authors.

Figure 1
Figure 1. The qualitative and quantitative comparison of our SDATC and other [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Comparison of different diffusion processes for image/video super [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Overview of the proposed Spatial Degradation-Aware and Temporal Consistent (SDATC) diffusion model. We apply a distortion control module [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (7 more)
Figure 4
Figure 4. Figure 4: The distortion control module (DCM) designed as the pre-processing [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]
Figure 5
Figure 5. Figure 5: The compression-aware prompt module (CAPM). CAPM extracts [PITH_FULL_IMAGE:figures/full_fig_p005_5.png]
Figure 6
Figure 6. Figure 6: Qualitative comparison of ×4 VSR on different compression level datasets. TABLE III COMPUTATIONAL EFFICIENCY COMPARISON. ALL METHODS ARE TESTED WITH A 320 × 180 FRAME OF ×4 VSR. Non-generative Methods Trainable Params. / Total Params. Runtime Generative Methods Trainab…
Figure 7
Figure 7. Figure 7: Qualitative comparison of ×4 VSR on different compression level datasets. demonstrate that SDATC excels in both structural rationality and detail clarity. In the presence of severe compression artifacts (e.g., CRF=25, 35), SDATC produces finer details and fewer compres…
Figure 9
Figure 9. Figure 9: LPIPS scores of different restoration methods. [PITH_FULL_IMAGE:figures/full_fig_p010_9.png]
Figure 11
Figure 11. Figure 11: Visual results of different restoration methods. [PITH_FULL_IMAGE:figures/full_fig_p010_11.png]
Figure 13
Figure 13. Figure 13: Temporal profile comparison. The temporal profiles are acquired [PITH_FULL_IMAGE:figures/full_fig_p011_13.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. DiffCVE: Diffusion-based Compressed Video Enhancement

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A diffusion-based video enhancement framework uses codec residuals, motion vectors, and QP-conditioned text prompts to improve the perceptual quality of heavily compressed videos.

Reference graph

Works this paper leans on

61 extracted references · 43 canonical work pages · cited by 1 Pith paper

  1. [1]

    Video super- resolution with convolutional neural networks,

    A. Kappeler, S. Yoo, Q. Dai, and A. K. Katsaggelos, “Video super- resolution with convolutional neural networks,” IEEE transactions on computational imaging, vol. 2, no. 2, pp. 109–122, 2016

    2016

  2. [2]

    Real-time video super-resolution with spatio-temporal networks and motion compensation,

    J. Caballero, C. Ledig, A. Aitken, A. Acosta, J. Totz, Z. Wang, and W. Shi, “Real-time video super-resolution with spatio-temporal networks and motion compensation,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 4778–4787

    work page 2017

  3. [3]

    Deep video super-resolution network using dynamic upsampling filters without explicit motion com- pensation,

    Y . Jo, S. W. Oh, J. Kang, and S. J. Kim, “Deep video super-resolution network using dynamic upsampling filters without explicit motion com- pensation,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 3224–3232

    2018

  4. [4]

    EDVR: Video restoration with enhanced deformable convolutional networks,

    X. Wang, K. C. Chan, K. Yu, C. Dong, and C. Change Loy, “EDVR: Video restoration with enhanced deformable convolutional networks,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops , 2019, pp. 1954–1963

    work page 2019

  5. [5]

    Multi-temporal ultra dense memory network for video super-resolution,

    P. Yi, Z. Wang, K. Jiang, Z. Shao, and J. Ma, “Multi-temporal ultra dense memory network for video super-resolution,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 8, pp. 2503– 2516, 2019

    work page 2019

  6. [6]

    MuCAN: Multi- correspondence aggregation network for video super-resolution,

    W. Li, X. Tao, T. Guo, L. Qi, J. Lu, and J. Jia, “MuCAN: Multi- correspondence aggregation network for video super-resolution,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part X 16 . Springer, 2020, pp. 335–351

    work page 2020

  7. [7]

    TDAN: Temporally-deformable alignment network for video super-resolution,

    Y . Tian, Y . Zhang, Y . Fu, and C. Xu, “TDAN: Temporally-deformable alignment network for video super-resolution,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 3360–3369

    work page 2020

  8. [8]

    Multi-branch networks for video super-resolution with dynamic reconstruction strat- egy,

    D. Zhang, J. Shao, Z. Liang, X. Liu, and H. T. Shen, “Multi-branch networks for video super-resolution with dynamic reconstruction strat- egy,” IEEE Transactions on Circuits and Systems for Video Technology , vol. 31, no. 10, pp. 3954–3966, 2020

    work page 2020

Show all 61 references
  1. [9]

    VRT: A video restoration transformer,

    J. Liang, J. Cao, Y . Fan, K. Zhang, R. Ranjan, Y . Li, R. Timofte, and L. Van Gool, “VRT: A video restoration transformer,”IEEE Transactions on Image Processing , 2024

    2024

  2. [10]

    Frame-recurrent video super-resolution,

    M. S. Sajjadi, R. Vemulapalli, and M. Brown, “Frame-recurrent video super-resolution,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 6626–6634

    2018

  3. [11]

    Efficient video super-resolution through recurrent latent space propagation,

    D. Fuoli, S. Gu, and R. Timofte, “Efficient video super-resolution through recurrent latent space propagation,” in 2019 IEEE/CVF Inter- national Conference on Computer Vision Workshop (ICCVW) . IEEE, 2019, pp. 3476–3485

    2019

  4. [12]

    Recurrent back-projection network for video super-resolution,

    M. Haris, G. Shakhnarovich, and N. Ukita, “Recurrent back-projection network for video super-resolution,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 3897– 3906

    2019

  5. [13]

    BasicVSR: The search for essential components in video super-resolution and beyond,

    K. C. Chan, X. Wang, K. Yu, C. Dong, and C. C. Loy, “BasicVSR: The search for essential components in video super-resolution and beyond,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 4947–4956

    2021

  6. [14]

    BasicVSR++: Improving video super-resolution with enhanced propagation and alignment,

    K. C. Chan, S. Zhou, X. Xu, and C. C. Loy, “BasicVSR++: Improving video super-resolution with enhanced propagation and alignment,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 5972–5981

    2022

  7. [15]

    Temporal consistency learning of inter-frames for video super-resolution,

    M. Liu, S. Jin, C. Yao, C. Lin, and Y . Zhao, “Temporal consistency learning of inter-frames for video super-resolution,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 33, no. 4, pp. 1507– 1520, 2022

    2022

  8. [16]

    Rethinking alignment in video super-resolution transformers,

    S. Shi, J. Gu, L. Xie, X. Wang, Y . Yang, and C. Dong, “Rethinking alignment in video super-resolution transformers,” Advances in Neural Information Processing Systems , vol. 35, pp. 36 081–36 093, 2022

    2022

  9. [17]

    CTVSR: Collab- orative spatial–temporal transformer for video super-resolution,

    J. Tang, C. Lu, Z. Liu, J. Li, H. Dai, and Y . Ding, “CTVSR: Collab- orative spatial–temporal transformer for video super-resolution,” IEEE Transactions on Circuits and Systems for Video Technology , vol. 34, no. 6, pp. 5018–5032, 2023

    2023

  10. [18]

    Video super-resolution transformer with masked inter&intra-frame attention,

    X. Zhou, L. Zhang, X. Zhao, K. Wang, L. Li, and S. Gu, “Video super-resolution transformer with masked inter&intra-frame attention,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 25 399–25 408. 12

    2024

  11. [19]

    Compression- aware video super-resolution,

    Y . Wang, T. Isobe, X. Jia, X. Tao, H. Lu, and Y .-W. Tai, “Compression- aware video super-resolution,” in Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, 2023, pp. 2012–2021

    2023

  12. [20]

    COMISR: Compression-informed video super-resolution,

    Y . Li, P. Jin, F. Yang, C. Liu, M.-H. Yang, and P. Milanfar, “COMISR: Compression-informed video super-resolution,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 2543– 2552

    2021

  13. [21]

    Learning spatiotemporal frequency- transformer for compressed video super-resolution,

    Z. Qiu, H. Yang, J. Fu, and D. Fu, “Learning spatiotemporal frequency- transformer for compressed video super-resolution,” in European Con- ference on Computer Vision . Springer, 2022, pp. 257–273

    2022

  14. [22]

    Real-ESRGAN: Training real- world blind super-resolution with pure synthetic data,

    X. Wang, L. Xie, C. Dong, and Y . Shan, “Real-ESRGAN: Training real- world blind super-resolution with pure synthetic data,” in Proceedings of the IEEE/CVF international conference on computer vision , 2021, pp. 1905–1914

    2021

  15. [23]

    Investigating tradeoffs in real-world video super-resolution,

    K. C. Chan, S. Zhou, X. Xu, and C. C. Loy, “Investigating tradeoffs in real-world video super-resolution,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 5962–5971

    2022

  16. [24]

    Image super-resolution via iterative refinement,

    C. Saharia, J. Ho, W. Chan, T. Salimans, D. J. Fleet, and M. Norouzi, “Image super-resolution via iterative refinement,” IEEE transactions on pattern analysis and machine intelligence, vol. 45, no. 4, pp. 4713–4726, 2022

    2022

  17. [25]

    Exploiting diffusion prior for real-world image super-resolution,

    J. Wang, Z. Yue, S. Zhou, K. C. Chan, and C. C. Loy, “Exploiting diffusion prior for real-world image super-resolution,” International Journal of Computer Vision , pp. 1–21, 2024

    2024

  18. [26]

    DiffBIR: Toward Blind Image Restoration with Gen- erative Diffusion Prior,

    X. Lin, J. He, Z. Chen, Z. Lyu, B. Dai, F. Yu, Y . Qiao, W. Ouyang, and C. Dong, “DiffBIR: Toward Blind Image Restoration with Gen- erative Diffusion Prior,” in European Conference on Computer Vision . Springer, 2025, pp. 430–448

    2025

  19. [27]

    Adding conditional control to text-to-image diffusion models,

    L. Zhang, A. Rao, and M. Agrawala, “Adding conditional control to text-to-image diffusion models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 3836–3847

    2023

  20. [28]

    Improving the stability of diffusion models for content consistent super-resolution,

    L. Sun, R. Wu, Z. Zhang, H. Yong, and L. Zhang, “Improving the stability of diffusion models for content consistent super-resolution,” arXiv preprint arXiv:2401.00877 , 2023

    2023 arXiv

  21. [29]

    SeeSR: Towards semantics-aware real-world image super-resolution, author=Wu, Rongyuan and Yang, Tao and Sun, Lingchen and Zhang, Zhengqiang and Li, Shuai and Zhang, Lei,

    “SeeSR: Towards semantics-aware real-world image super-resolution, author=Wu, Rongyuan and Yang, Tao and Sun, Lingchen and Zhang, Zhengqiang and Li, Shuai and Zhang, Lei,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024, pp. 25 456–25 467

    2024

  22. [30]

    CoSeR: Bridging image and language for cognitive super-resolution,

    H. Sun, W. Li, J. Liu, H. Chen, R. Pei, X. Zou, Y . Yan, and Y . Yang, “CoSeR: Bridging image and language for cognitive super-resolution,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 25 868–25 878

    2024

  23. [31]

    Scaling up to excellence: Practicing model scaling for photo- realistic image restoration in the wild,

    F. Yu, J. Gu, Z. Li, J. Hu, X. Kong, X. Wang, J. He, Y . Qiao, and C. Dong, “Scaling up to excellence: Practicing model scaling for photo- realistic image restoration in the wild,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp....

    2024

  24. [32]

    SSP- IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration,

    Y . Zhang, H. Zhang, Z. Cheng, R. Xie, L. Song, and W. Zhang, “SSP- IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration,” IEEE Transactions on Circuits and Systems for Video Technology, 2025

    2025

  25. [33]

    Enhancing perceptual quality in video super-resolution through temporally-consistent detail synthesis using diffusion models,

    C. Rota, M. Buzzelli, and J. van de Weijer, “Enhancing perceptual quality in video super-resolution through temporally-consistent detail synthesis using diffusion models,” in European Conference on Computer Vision. Springer, 2024, pp. 36–53

    2024

  26. [34]

    Learning spatial adaptation and temporal coherence in diffusion models for video super-resolution,

    Z. Chen, F. Long, Z. Qiu, T. Yao, W. Zhou, J. Luo, and T. Mei, “Learning spatial adaptation and temporal coherence in diffusion models for video super-resolution,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 9232–9241

    2024

  27. [35]

    Upscale-A- Video: Temporal-consistent diffusion model for real-world video super- resolution,

    S. Zhou, P. Yang, J. Wang, Y . Luo, and C. C. Loy, “Upscale-A- Video: Temporal-consistent diffusion model for real-world video super- resolution,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 2535–2545

    2024

  28. [36]

    Motion-guided latent diffusion for temporally consistent real-world video super-resolution,

    X. Yang, C. He, J. Ma, and L. Zhang, “Motion-guided latent diffusion for temporally consistent real-world video super-resolution,” in European Conference on Computer Vision . Springer, 2025, pp. 224–242

    2025

  29. [37]

    Deformable convolutional networks,

    J. Dai, H. Qi, Y . Xiong, Y . Li, G. Zhang, H. Hu, and Y . Wei, “Deformable convolutional networks,” in Proceedings of the IEEE international conference on computer vision , 2017, pp. 764–773

    2017

  30. [38]

    Learning degradation- robust spatiotemporal frequency-transformer for video super-resolution,

    Z. Qiu, H. Yang, J. Fu, D. Liu, C. Xu, and D. Fu, “Learning degradation- robust spatiotemporal frequency-transformer for video super-resolution,” IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 45, no. 12, pp. 14 888–14 904, 2023

    2023

  31. [39]

    Real-world video super- resolution: A benchmark dataset and a decomposition based learning scheme,

    X. Yang, W. Xiang, H. Zeng, and L. Zhang, “Real-world video super- resolution: A benchmark dataset and a decomposition based learning scheme,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 4781–4790

    2021

  32. [40]

    Overview of the h. 264/avc video coding standard,

    T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the h. 264/avc video coding standard,” IEEE Transactions on circuits and systems for video technology , vol. 13, no. 7, pp. 560–576, 2003

    2003

  33. [41]

    High- resolution image synthesis with latent diffusion models,

    R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High- resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 10 684–10 695

    2022

  34. [42]

    Taming transformers for high- resolution image synthesis,

    P. Esser, R. Rombach, and B. Ommer, “Taming transformers for high- resolution image synthesis,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2021, pp. 12 873–12 883

    2021

  35. [43]

    SwinIR: Image restoration using swin transformer,

    J. Liang, J. Cao, G. Sun, K. Zhang, L. Van Gool, and R. Timofte, “SwinIR: Image restoration using swin transformer,” in Proceedings of the IEEE/CVF international conference on computer vision , 2021, pp. 1833–1844

    2021

  36. [44]

    PromptIR: Prompting for all-in-one image restoration, author=Potlapalli, Vaishnav and Zamir, Syed Waqas and Khan, Salman H and Shahbaz Khan, Fahad,

    “PromptIR: Prompting for all-in-one image restoration, author=Potlapalli, Vaishnav and Zamir, Syed Waqas and Khan, Salman H and Shahbaz Khan, Fahad,” Advances in Neural Information Processing Systems, vol. 36, 2024

    2024

  37. [45]

    RAFT: Recurrent all-pairs field transforms for optical flow,

    Z. Teed and J. Deng, “RAFT: Recurrent all-pairs field transforms for optical flow,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II

    2020

  38. [46]

    Springer, 2020, pp. 402–419

    2020

  39. [47]

    Perception pri- oritized training of diffusion models,

    J. Choi, J. Lee, C. Shin, S. Kim, H. Kim, and S. Yoon, “Perception pri- oritized training of diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 11 472–11 481

    2022

  40. [48]

    Arbitrary style transfer in real-time with adaptive instance normalization,

    X. Huang and S. Belongie, “Arbitrary style transfer in real-time with adaptive instance normalization,” in Proceedings of the IEEE interna- tional conference on computer vision , 2017, pp. 1501–1510

    2017

  41. [49]

    NTIRE 2019 challenge on video deblurring and super-resolution: Dataset and study,

    S. Nah, S. Baik, S. Hong, G. Moon, S. Son, R. Timofte, and K. Mu Lee, “NTIRE 2019 challenge on video deblurring and super-resolution: Dataset and study,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops , 2019, pp. 0–0

    2019

  42. [50]

    On bayesian adaptive video super resolution,

    C. Liu and D. Sun, “On bayesian adaptive video super resolution,” IEEE transactions on pattern analysis and machine intelligence, vol. 36, no. 2, pp. 346–360, 2013

    2013

  43. [51]

    Progressive fusion video super-resolution network via exploiting non-local spatio-temporal correlations,

    P. Yi, Z. Wang, K. Jiang, J. Jiang, and J. Ma, “Progressive fusion video super-resolution network via exploiting non-local spatio-temporal correlations,” in Proceedings of the IEEE/CVF international conference on computer vision , 2019, pp. 3106–3115

    2019

  44. [52]

    Adam: a method for stochastic optimization,

    D. Kingma, “Adam: a method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014

    2014 arXiv

  45. [53]

    Image quality assessment: from error visibility to structural similarity,

    Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE transactions on image processing , vol. 13, no. 4, pp. 600–612, 2004

    2004

  46. [54]

    The unreasonable effectiveness of deep features as a perceptual metric,

    R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 586–595

    2018

  47. [55]

    Image quality assessment: Unifying structure and texture similarity,

    K. Ding, K. Ma, S. Wang, and E. P. Simoncelli, “Image quality assessment: Unifying structure and texture similarity,”IEEE transactions on pattern analysis and machine intelligence , vol. 44, no. 5, pp. 2567– 2581, 2020

    2020

  48. [56]

    Gans trained by a two time-scale update rule converge to a local nash equilibrium,

    M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “Gans trained by a two time-scale update rule converge to a local nash equilibrium,” Advances in neural information processing systems , vol. 30, 2017

    2017

  49. [57]

    Making a “completely blind

    A. Mittal, R. Soundararajan, and A. C. Bovik, “Making a “completely blind” image quality analyzer,” IEEE Signal processing letters , vol. 20, no. 3, pp. 209–212, 2012

    2012

  50. [58]

    MANIQA: Multi-dimension attention network for no-reference image quality assessment,

    S. Yang, T. Wu, S. Shi, S. Lao, Y . Gong, M. Cao, J. Wang, and Y . Yang, “MANIQA: Multi-dimension attention network for no-reference image quality assessment,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 1191–1200

    2022

  51. [59]

    Exploring clip for assessing the look and feel of images,

    J. Wang, K. C. Chan, and C. C. Loy, “Exploring clip for assessing the look and feel of images,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 2, 2023, pp. 2555–2563

    2023

  52. [60]

    Details or artifacts: A locally discriminative learning approach to realistic image super-resolution,

    J. Liang, H. Zeng, and L. Zhang, “Details or artifacts: A locally discriminative learning approach to realistic image super-resolution,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 5657–5666

    2022

  53. [61]

    Toward a practical perceptual video quality metric,

    N. Blog, “Toward a practical perceptual video quality metric,” 2016

    2016

Pith tools

Reviewed August 8, 2026 · model on record in the stance chip above.