Pith. sign in

REVIEW 3 major objections 4 minor 1 cited by

HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Prior

T0 review · 3 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read By using semantic segmentation both as concise text prompts and as pixel-level spatial guidance, HoliSDiP makes diffusion-based real-world super-resolution produce sharper, more semantically correct details.

desk verdict Real idea—segmentation as one source for prompts and dense guidance in diffusion SR—with broad experiments, but the segmentation-quality ablation contradicts its own table and the core assumption about LR-domain segmentation is untested. read the letter →

arxiv 2411.18662 v1 pith:F3WA5GRW submitted 2024-11-27 cs.CV

Li-Yuan Tsao , Hao-Wei Chen , Hao-Wei Chung , Deqing Sun , Chun-Yi Lee , Kelvin C.K. Chan , Ming-Hsuan Yang This is my paper · ORCID
classification cs.CV
keywords real-worldimagesuper-resolutiontext-to-imagediffusionpriorsemanticsegmentationguidancelabelpromptingdenseSegmentation-CLIPMappromptnoisereductionperceptualquality
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that the weak point of text-to-image diffusion priors for real-world super-resolution is the text prompt itself: auto-taggers and LLMs produce redundant or wrong descriptions that are not spatially aligned with the image. It proposes to replace those prompts with semantic labels from a segmentation model, and to add dense per-pixel semantic guidance alongside them. The claimed result is that this combination reduces prompt noise and adds spatial control, yielding perceptually better super-resolved images across synthetic and real-world benchmarks. A sympathetic reader would care because this is a cheap fix: the segmentation model is frozen and interchangeable, and the same labels drive both text and spatial conditioning.

What carries the argument

The load-bearing object is the Segmentation-CLIP Map (SCMap): a tensor where each pixel carries the CLIP text embedding of its segmentation label, preserving the spatial layout while injecting semantic meaning. Together with the raw segmentation mask, SCMap is fused into the denoising UNet's intermediate features by the Guidance Fusion Module, whose two Semantic-Adaptive Feature Transformation blocks, adapted from the SPADE block, predict pixel-wise scale and shift parameters. The same segmentation map also yields the text prompt via Semantic Label-Based Prompting, so one representation supplies both global and local control.

What would settle it

Take a set of real-world low-resolution images with manual ground-truth semantic labels, run HoliSDiP twice, once with automatic Mask2Former segmentation and once with the true labels, and compare perceptual metrics; if the true-label version is not better, or if automatic mislabels still yield high scores, the claim that accurate segmentation drives the gains is falsified.

Watch

Extended reading notes

Core claim

HoliSDiP's central claim is that a single semantic segmentation representation can replace noisy text prompts and supply spatially aligned control for diffusion-based Real-ISR. Semantic Label-Based Prompting turns the set of detected class names into the text prompt, while Dense Semantic Guidance feeds the segmentation mask and a Segmentation-CLIP Map (per-pixel CLIP text embeddings of the label) into the diffusion UNet through a Guidance Fusion Module that applies per-pixel scale and shift transformations. In experiments against GAN, diffusion, and diffusion-prior baselines, the method reports leading non-reference perceptual scores (for example, 15.6% higher MANIQA and 10.9% higher CLIPIQA than the second-best on RealSR) and qualitatively restores textures and boundaries with fewer artifacts.

Load-bearing premise

The framework assumes a frozen segmentation model labels heavily degraded low-resolution images accurately enough to guide generation; the paper's own segmentation-quality ablation shows output quality tracks segmentation quality, although the Table 4 text and table disagree about which backbone achieves the best mIoU, so the robustness evidence should be read carefully before relying on it.

Editorial extensions

If this is right

  • Replacing auto-tagged or LLM-generated prompts with compact semantic labels reduces redundant or erroneous descriptions and improves fidelity, with the paper's ablation on RealSR showing PSNR rising from 22.9629 to 23.5303.
  • Dense semantic guidance prevents hallucinated details: the segmentation mask preserves structure, SCMap supplies context, and their fusion yields the best perceptual quality in the ablation.
  • Output quality tracks segmentation quality: better segmentation (higher mIoU) gives better super-resolution metrics, while the framework remains usable when the segmentation backbone is weaker.
  • The framework improves non-reference perceptual metrics across synthetic and real-world datasets (DIV2K, RealSR, DrealSR, DPED-iPhone), with competitive reference-based fidelity among diffusion-prior methods.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Not tested here but plausible: the same frozen-segmentation-plus-SCMap recipe transfers to other restoration tasks such as deblurring or deraining, where semantic constraints also limit the set of plausible output textures.
  • The ADE20K vocabulary (150 classes) bounds what the prompt can express; objects outside that vocabulary would be mislabeled, so open-vocabulary segmentation is the natural next stress test.
  • The SCMap idea is a general way to inject dense semantics into a diffusion UNet and could be reused for controlled image editing or semantic image synthesis without retraining the base model.
  • Editing the label set by hand may allow interactive control over local texture, which the paper's 'building' versus 'soil' experiment hints at, turning the method into a steerable super-resolution tool.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. HoliSDiP proposes a diffusion-prior-based real-world super-resolution framework that replaces noisy automatic text prompts with semantic labels obtained from a frozen Mask2Former segmentation model, and augments these with dense spatial guidance: a segmentation mask and a proposed Segmentation-CLIP Map (SCMap) encoding per-pixel class labels as CLIP text embeddings. A Guidance Fusion Module injects this dense semantic information into the denoising UNet via SPADE-like affine transformations alongside ControlNet and LR cross-attention. The paper validates the method on RealSR, DrealSR, DIV2K-Val, and DPED-iPhone, reporting leading non-reference perceptual metrics (MUSIQ, MANIQA, CLIPIQA) and competitive reference-based metrics, with ablations on the prompting scheme, dense guidance components, and segmentation backbone quality.

Significance. If the empirical claims hold, the core idea—using semantic segmentation as a unified source of both concise text prompts and pixel-aligned dense guidance for text-to-image diffusion SR—is a reasonable and potentially useful contribution to the Real-ISR literature. The paper addresses a real limitation of prior prompt-based methods, is evaluated on four datasets against a large set of state-of-the-art baselines, and provides the evaluation code publicly. However, the significance depends on two currently unverified assumptions: that the frozen segmentation model is reliable on degraded low-resolution inputs, and that the reported perceptual-metric gains are statistically meaningful. The manuscript also contains a direct internal contradiction in its key segmentation-robustness ablation. These issues undermine the strength of the central claims as currently presented, though they appear addressable with additional experiments and corrections.

major comments (3)
  1. [4.3, Table 4] The text states that Mask2Former with Swin-T achieves the highest mIoU and consequently the best SR results, but Table 4 reports the opposite: Swin-L has mIoU 56.1 and the best scores on every SR metric, while Swin-T has mIoU 47.7 and the worst scores. This is not a cosmetic typo because the paragraph's robustness conclusion depends on which backbone is best. As reported, the data indicate that SR quality tracks segmentation quality rather than showing robustness to segmentation quality. Moreover, the mIoU is evaluated on the clean ADE20K validation set, not on the degraded 128×128 LR inputs the system actually processes, so the domain-transfer assumption behind the central method remains untested.
  2. [3.2 / 4.1] The method's central premise is that Mask2Former, trained on clean ADE20K images, provides reliable semantic information when applied to degraded 128×128 LR inputs. No experiment measures segmentation accuracy in this domain; Table 4 reports mIoU only on the clean ADE20K validation set. This matters because Fig. 7 demonstrates that a wrong semantic prior ('Soil', 'Painting') produces visually coherent but semantically incorrect textures. If Mask2Former systematically mislabels degraded LR inputs, the text prompts and dense guidance will inject the same kind of wrong semantics, directly undermining the method's main claimed benefit. Please add a direct evaluation of segmentation accuracy on the LR/degraded domain (e.g., a synthetic degraded ADE20K validation split) or an explicit sensitivity analysis showing that final SR quality is insensitive to such segmentation errors.
  3. [4.2, Table 1] The headline quantitative claims rest on non-reference perceptual metrics (MUSIQ, MANIQA, CLIPIQA) reported as single-run point estimates without error bars, confidence intervals, or significance tests. This is particularly concerning because CLIPIQA may share representation space with the CLIP embeddings used by the proposed method, creating a potential evaluation bias, and because PSNR/SSIM are not improved over several baselines (e.g., PSNR on RealSR is 23.53 vs. 24.53 for SeeSR). Please report variance across multiple evaluation runs or provide statistical significance tests, and discuss the potential CLIP-based metric bias explicitly.
minor comments (4)
  1. [4.2, Quantitative Comparison] The phrase 'HoliSDiP demonstrates competitive performance' is hard to reconcile with Table 1, where HoliSDiP's PSNR and SSIM are lower than several diffusion prior-based baselines; please rephrase to accurately reflect the perception-distortion trade-off rather than implying overall competitiveness on fidelity.
  2. [4.3, Impact of Semantic Segmentation Quality] The sentence 'These results demonstrate that the proposed HoliSDiP is robust to different levels of segmentation quality' is not supported by the table as reported; after correcting the direction of the relationship, please either reword the conclusion or provide evidence that the degradation in SR metrics is within acceptable bounds.
  3. [1. Introduction / 4.2] There are minor grammatical issues, such as 'HoliSDiP gain a 10.3% enhancement' in Section 4.2, and the caption of Fig. 7 refers to an 'open sky setting,' which is unclear; please proofread.
  4. [4.1] The project/evaluation code links are given without a space before the URL ('available at:https://github.com/...'); this is a minor formatting issue.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; HoliSDiP's improvements are empirical and self-contained, with no fitted parameter renamed as a prediction.

full rationale

The paper makes no analytic derivation that reduces to its inputs. HoliSDiP is an empirical framework: frozen Mask2Former and CLIP encoders provide prompts and dense guidance, while the trainable GFM and SCMap compressor are optimized with a standard diffusion noise-prediction objective on synthetic LR-HR pairs. The headline gains are measured by external metrics (MUSIQ, MANIQA, CLIPIQA) that are not optimized during training and are publicly implemented; the same conclusion is supported by multiple non-reference metrics, so the use of CLIPIQA is not a by-construction overlap with the CLIP-text-encoder-based SCMap of Eq. (1). Self-citations to StableSR [48] and CLIPIQA [47] are normal citations to public baselines/metrics and are not load-bearing in the sense of a unique theorem or an unverified prior restricting the solution space. The internal inconsistency in Table 4, where the text claims Swin-T has the highest mIoU while the table shows Swin-L highest, and the unmeasured segmentation accuracy on degraded LR inputs, are genuine correctness/robustness concerns, but they are not circularity: the method's definition does not presuppose its evaluation outcome, and no fitted parameter is relabeled as a prediction.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The central claim depends on the reliability of the segmentation model on degraded LR images and on the validity of perceptual metrics. These are domain assumptions, not derived within the paper. No hand-fitted constants or invented entities appear.

assumptions (3)
  • domain assumption Pre-trained text-to-image diffusion models (Stable Diffusion 2-base) provide a useful generative prior for real-world image super-resolution.
    The entire method builds on SD-2-base as the backbone; if this prior is ineffective, the guidance mechanism cannot help. Invoked throughout Section 3.1.
  • domain assumption Mask2Former trained on ADE20K produces reliable segmentation on low-resolution, degraded inputs.
    The segmentation results drive both the text prompts (SLBP) and the dense guidance (DSG). Entering at Section 3.2 and Table 4, where sensitivity to segmentation quality is tested.
  • domain assumption The chosen perceptual metrics (MUSIQ, MANIQA, CLIPIQA) are valid proxies for real image quality and are not biased by the method's use of CLIP embeddings.
    Headline results are non-reference metric scores (Section 4.1); if these metrics are biased or noisy, the 'significant improvement' claim weakens.

how reviews work

0 comments
Cite this review

Pith. "Pith review of HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Prior." pith.science (2026). https://pith.science/paper/F3WA5GRW

@misc{pith2026241118662,
  author       = {Pith},
  title        = {Pith review of: HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Prior},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/F3WA5GRW}},
  note         = {Machine review of arXiv:2411.18662}
}
read the original abstract

Text-to-image diffusion models have emerged as powerful priors for real-world image super-resolution (Real-ISR). However, existing methods may produce unintended results due to noisy text prompts and their lack of spatial information. In this paper, we present HoliSDiP, a framework that leverages semantic segmentation to provide both precise textual and spatial guidance for diffusion-based Real-ISR. Our method employs semantic labels as concise text prompts while introducing dense semantic guidance through segmentation masks and our proposed Segmentation-CLIP Map. Extensive experiments demonstrate that HoliSDiP achieves significant improvement in image quality across various Real-ISR scenarios through reduced prompt noise and enhanced spatial control.

Figures

Figures reproduced from arXiv: 2411.18662 by the authors.

Figure 1
Figure 1. The proposed HoliSDiP performs well against the state-of-the-art frameworks [ [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Comparison between the proposed HoliSDiP and exist [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Overview of HoliSDiP. The segmentation model first processes the LR image to generate segmentation results, which is used [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison between the proposed HoliSDiP and contemporary Real-ISR methods. HoliSDiP presents sharper details [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]
Figure 5
Figure 5. Figure 5: Qualitative comparison between using image tags [ [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Illustrative examples presenting the effect of employing [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]
Figure 7
Figure 7. Figure 7: Illustrative examples showing the impact of seman [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Optimization-Free Universal Watermark Forgery with Regenerative Diffusion Models

    cs.MM 2025-06 conditional novelty 6.0 of 10

    Extracting a watermark latent from a target image and injecting it into a pre-trained regeneration model forges watermarks onto arbitrary cover images without optimization, but only reliably for Gaussian Shading on UN...

Reference graph

Works this paper leans on

70 extracted references · 52 canonical work pages · cited by 1 Pith paper

  1. [1]

    Ntire 2017 challenge on single image super-resolution: Dataset and study

    Eirikur Agustsson and Radu Timofte. Ntire 2017 challenge on single image super-resolution: Dataset and study. In CVPRW, 2017. 5, 6

    work page 2017

  2. [2]

    Blind super-resolution kernel estimation using an internal-gan

    Sefi Bell-Kligler, Assaf Shocher, and Michal Irani. Blind super-resolution kernel estimation using an internal-gan. In NeurIPS, 2019. 3

    work page 2019

  3. [3]

    The perception-distortion tradeoff

    Yochai Blau and Tomer Michaeli. The perception-distortion tradeoff. In CVPR, 2018. 6

    2018

  4. [4]

    To learn image super-resolution, use a gan to learn how to do image degradation first

    Adrian Bulat, Jing Yang, and Georgios Tzimiropoulos. To learn image super-resolution, use a gan to learn how to do image degradation first. In ECCV, 2018. 3

    work page 2018

  5. [5]

    Toward real-world single image super-resolution: A new benchmark and a new model

    Jianrui Cai, Hui Zeng, Hongwei Yong, Zisheng Cao, and Lei Zhang. Toward real-world single image super-resolution: A new benchmark and a new model. In ICCV, 2019. 5, 6

    work page 2019

  6. [6]

    Ciaosr: Continuous implicit attention-in- attention network for arbitrary-scale image super-resolution

    Jiezhang Cao, Qin Wang, Yongqin Xian, Yawei Li, Bingbing Ni, Zhiming Pi, Kai Zhang, Yulun Zhang, Radu Timofte, and Luc Van Gool. Ciaosr: Continuous implicit attention-in- attention network for arbitrary-scale image super-resolution. In CVPR, 2023. 3

    work page 2023

  7. [7]

    Chan, Xintao Wang, Xiangyu Xu, Jinwei Gu, and Chen Change Loy

    Kelvin C.K. Chan, Xintao Wang, Xiangyu Xu, Jinwei Gu, and Chen Change Loy. Glean: Generative latent bank for large-factor image super-resolution. In CVPR, 2021. 3

    work page 2021

  8. [8]

    Real-world blind super-resolution via feature matching with implicit high- resolution priors

    Chaofeng Chen, Xinyu Shi, Yipeng Qin, Xiaoming Li, Xi- aoguang Han, Tao Yang, and Shihui Guo. Real-world blind super-resolution via feature matching with implicit high- resolution priors. In ACMMM, 2022. 3

    work page 2022

Show all 70 references
  1. [9]

    Cascaded local implicit transformer for arbitrary-scale super-resolution

    Hao-Wei Chen, Yu-Syuan Xu, Min-Fong Hong, Yi-Min Tsai, Hsien-Kai Kuo, and Chun-Yi Lee. Cascaded local implicit transformer for arbitrary-scale super-resolution. In CVPR, 2023. 3

    2023

  2. [10]

    Learning con- tinuous image representation with local implicit image func- tion

    Yinbo Chen, Sifei Liu, and Xiaolong Wang. Learning con- tinuous image representation with local implicit image func- tion. In CVPR, 2021. 3

    2021

  3. [11]

    Masked-attention mask transformer for universal image segmentation

    Bowen Cheng, Ishan Misra, Alexander G Schwing, Alexan- der Kirillov, and Rohit Girdhar. Masked-attention mask transformer for universal image segmentation. In CVPR,

  4. [12]

    Image super-resolution using deep convolutional net- works

    Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. Image super-resolution using deep convolutional net- works. TPAMI, 2015. 2

    2015

  5. [13]

    Frequency separation for real-world super-resolution

    Manuel Fritsche, Shuhang Gu, and Radu Timofte. Frequency separation for real-world super-resolution. In ICCVW, 2019. 3

    2019

  6. [14]

    Blind super-resolution with iterative kernel correction

    Jinjin Gu, Hannan Lu, Wangmeng Zuo, and Chao Dong. Blind super-resolution with iterative kernel correction. In CVPR, 2019. 3

    2019

  7. [15]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In CVPR,

  8. [16]

    Denoising diffu- sion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models. NeurIPS, 2020. 3

    2020

  9. [17]

    Meta-sr: A magnification-arbitrary network for super-resolution

    Xuecai Hu, Haoyuan Mu, Xiangyu Zhang, Zilei Wang, Tie- niu Tan, and Jian Sun. Meta-sr: A magnification-arbitrary network for super-resolution. In CVPR, 2019. 3

    2019

  10. [18]

    Dslr-quality photos on mobile devices with deep convolutional networks

    Andrey Ignatov, Nikolay Kobyshev, Radu Timofte, Kenneth Vanhoey, and Luc Van Gool. Dslr-quality photos on mobile devices with deep convolutional networks. In ICCV, 2017. 5, 6

    2017

  11. [19]

    A style-based generator architecture for generative adversarial networks

    Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. In CVPR, 2019. 5

    2019

  12. [20]

    Musiq: Multi-scale image quality transformer

    Junjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar, and Feng Yang. Musiq: Multi-scale image quality transformer. In ICCV, 2021. 5

    2021

  13. [21]

    Photo- realistic single image super-resolution using a generative ad- versarial network

    Christian Ledig, Lucas Theis, Ferenc Husz´ar, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, et al. Photo- realistic single image super-resolution using a generative ad- versarial network. In CVPR, 2017. 2

    2017

  14. [22]

    Local texture estimator for implicit representation function

    Jaewon Lee and Kyong Hwan Jin. Local texture estimator for implicit representation function. In CVPR, 2022. 3

    2022

  15. [23]

    Srdiff: Single image super-resolution with diffusion probabilistic models

    Haoying Li, Yifan Yang, Meng Chang, Shiqi Chen, Huajun Feng, Zhihai Xu, Qi Li, and Yueting Chen. Srdiff: Single image super-resolution with diffusion probabilistic models. Neurocomputing, 2022. 3

    2022

  16. [24]

    Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models

    Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In ICML,

  17. [25]

    Lsdir: A large scale dataset for image restoration

    Yawei Li, Kai Zhang, Jingyun Liang, Jiezhang Cao, Ce Liu, Rui Gong, Yulun Zhang, Hao Tang, Yun Liu, Denis Deman- dolx, et al. Lsdir: A large scale dataset for image restoration. In CVPR, 2023. 5

    2023

  18. [26]

    Swinir: Image restoration us- ing swin transformer

    Jingyun Liang, Jiezhang Cao, Guolei Sun, Kai Zhang, Luc Van Gool, and Radu Timofte. Swinir: Image restoration us- ing swin transformer. In ICCV, 2021. 5

    2021

  19. [27]

    Hierarchi- cal conditional flow: A unified framework for image super- resolution and image rescaling

    Jingyun Liang, Andreas Lugmayr, Kai Zhang, Martin Danelljan, Luc Van Gool, and Radu Timofte. Hierarchi- cal conditional flow: A unified framework for image super- resolution and image rescaling. In ICCV, 2021. 3

    2021

  20. [28]

    Enhanced deep residual networks for single image super-resolution

    Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. Enhanced deep residual networks for single image super-resolution. In CVPRW, 2017. 2, 5

    2017

  21. [29]

    Diff- bir: Towards blind image restoration with generative diffu- sion prior

    Xinqi Lin, Jingwen He, Ziyan Chen, Zhaoyang Lyu, Bo Dai, Fanghua Yu, Wanli Ouyang, Yu Qiao, and Chao Dong. Diff- bir: Towards blind image restoration with generative diffu- sion prior. arXiv preprint arXiv:2308.15070, 2023. 1, 3, 5

    2023 arXiv

  22. [30]

    Improved baselines with visual instruction tuning

    Haotian Liu, Chunyuan Li, Yuheng Li, and Yong Jae Lee. Improved baselines with visual instruction tuning. In CVPR,

  23. [31]

    Swin transformer: Hierarchical vision transformer using shifted windows

    Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. In ICCV, 2021. 5, 8

    2021

  24. [32]

    Fixing weight decay regularization in adam

    Ilya Loshchilov, Frank Hutter, et al. Fixing weight decay regularization in adam. arXiv preprint arXiv:1711.05101 ,

    arXiv

  25. [33]

    Srflow: Learning the super-resolution space with normalizing flow

    Andreas Lugmayr, Martin Danelljan, Luc Van Gool, and Radu Timofte. Srflow: Learning the super-resolution space with normalizing flow. In ECCV, 2020. 3

    2020

  26. [34]

    Improved denoising diffusion probabilistic models

    Alexander Quinn Nichol and Prafulla Dhariwal. Improved denoising diffusion probabilistic models. In ICML, 2021. 5 9

    2021

  27. [35]

    Semantic image synthesis with spatially-adaptive nor- malization

    Taesung Park, Ming-Yu Liu, Ting-Chun Wang, and Jun-Yan Zhu. Semantic image synthesis with spatially-adaptive nor- malization. In CVPR, 2019. 4

    2019

  28. [36]

    Xpsr: Cross-modal priors for diffusion-based image super-resolution

    Yunpeng Qu, Kun Yuan, Kai Zhao, Qizhi Xie, Jinhua Hao, Ming Sun, and Chao Zhou. Xpsr: Cross-modal priors for diffusion-based image super-resolution. In ECCV, 2024. 3

    2024

  29. [37]

    Learn- ing transferable visual models from natural language super- vision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learn- ing transferable visual models from natural language super- vision. In ICML, 2021. 3, 4

    2021

  30. [38]

    You only look once: unified, real-time object detec- tion

    Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look once: unified, real-time object detec- tion. In CVPR, 2016. 3

    2016

  31. [39]

    High-resolution image syn- thesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj¨orn Ommer. High-resolution image syn- thesis with latent diffusion models. In CVPR, 2022. 1, 3

    2022

  32. [40]

    Image super- resolution via iterative refinement

    Chitwan Saharia, Jonathan Ho, William Chan, Tim Sali- mans, David J Fleet, and Mohammad Norouzi. Image super- resolution via iterative refinement. TPAMI, 2022. 3

    2022

  33. [41]

    zero-shot

    Assaf Shocher, Nadav Cohen, and Michal Irani. “zero-shot” super-resolution using deep internal learning. In CVPR,

  34. [42]

    Meta- transfer learning for zero-shot super-resolution

    Jae Woong Soh, Sunwoo Cho, and Nam Ik Cho. Meta- transfer learning for zero-shot super-resolution. In CVPR,

  35. [43]

    Image super-resolution using gradient profile prior

    Jian Sun, Zongben Xu, and Heung-Yeung Shum. Image super-resolution using gradient profile prior. InCVPR, 2008. 1

    2008

  36. [44]

    Improving the stability of dif- fusion models for content consistent super-resolution

    Lingchen Sun, Rongyuan Wu, Zhengqiang Zhang, Hong- wei Yong, and Lei Zhang. Improving the stability of dif- fusion models for content consistent super-resolution. arXiv preprint arXiv:2401.00877, 2023. 3

    2023 arXiv

  37. [45]

    Boosting flow-based generative super-resolution models via learned prior

    Li-Yuan Tsao, Yi-Chen Lo, Chia-Che Chang, Hao-Wei Chen, Roy Tseng, Chien Feng, and Chun-Yi Lee. Boosting flow-based generative super-resolution models via learned prior. In CVPR, 2024. 3

    2024

  38. [46]

    Deep image prior

    Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. Deep image prior. In CVPR, 2018. 1

    2018

  39. [47]

    Chan, and Chen Change Loy

    Jianyi Wang, Kelvin C.K. Chan, and Chen Change Loy. Ex- ploring clip for assessing the look and feel of images. In AAAI, 2023. 5, 6, 8

    2023

  40. [48]

    Chan, and Chen Change Loy

    Jianyi Wang, Zongsheng Yue, Shangchen Zhou, Kelvin C.K. Chan, and Chen Change Loy. Exploiting diffusion prior for real-world image super-resolution. IJCV, 2024. 3, 5

    2024

  41. [49]

    Recovering realistic texture in image super-resolution by deep spatial feature transform

    Xintao Wang, Ke Yu, Chao Dong, and Chen Change Loy. Recovering realistic texture in image super-resolution by deep spatial feature transform. In CVPR, 2018. 3

    2018

  42. [50]

    Esrgan: En- hanced super-resolution generative adversarial networks

    Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. Esrgan: En- hanced super-resolution generative adversarial networks. In ECCVW, 2018. 3

    2018

  43. [51]

    Real-esrgan: Training real-world blind super-resolution with pure synthetic data

    Xintao Wang, Liangbin Xie, Chao Dong, and Ying Shan. Real-esrgan: Training real-world blind super-resolution with pure synthetic data. In ICCV, 2021. 3, 5

    2021

  44. [52]

    Sinsr: diffusion-based image super- resolution in a single step

    Yufei Wang, Wenhan Yang, Xinyuan Chen, Yaohui Wang, Lanqing Guo, Lap-Pui Chau, Ziwei Liu, Yu Qiao, Alex C Kot, and Bihan Wen. Sinsr: diffusion-based image super- resolution in a single step. In CVPR, 2024. 3, 5

    2024

  45. [53]

    Image quality assessment: from error visibility to structural similarity

    Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process., 2004. 5

    2004

  46. [54]

    Component divide-and-conquer for real-world image super-resolution

    Pengxu Wei, Ziwei Xie, Hannan Lu, Zongyuan Zhan, Qix- iang Ye, Wangmeng Zuo, and Liang Lin. Component divide-and-conquer for real-world image super-resolution. In ECCV, 2020. 5, 6

    2020

  47. [55]

    One-step effective diffusion network for real-world image super-resolution

    Rongyuan Wu, Lingchen Sun, Zhiyuan Ma, and Lei Zhang. One-step effective diffusion network for real-world image super-resolution. arXiv preprint arXiv:2406.08177, 2024. 5

    2024 arXiv

  48. [56]

    Seesr: Towards semantics-aware real-world image super-resolution

    Rongyuan Wu, Tao Yang, Lingchen Sun, Zhengqiang Zhang, Shuai Li, and Lei Zhang. Seesr: Towards semantics-aware real-world image super-resolution. In CVPR, 2024. 1, 3, 5, 6, 7

    2024

  49. [57]

    Image super-resolution via sparse representation

    Jianchao Yang, John Wright, Thomas S Huang, and Yi Ma. Image super-resolution via sparse representation. TIP, 2010. 1

    2010

  50. [58]

    Maniqa: Multi-dimension attention network for no-reference image quality assessment

    Sidi Yang, Tianhe Wu, Shuwei Shi, Shanshan Lao, Yuan Gong, Mingdeng Cao, Jiahao Wang, and Yujiu Yang. Maniqa: Multi-dimension attention network for no-reference image quality assessment. In CVPRW, 2022. 5, 6, 8

    2022

  51. [59]

    Pixel-aware stable diffusion for realistic im- age super-resolution and personalized stylization

    Tao Yang, Rongyuan Wu, Peiran Ren, Xuansong Xie, and Lei Zhang. Pixel-aware stable diffusion for realistic im- age super-resolution and personalized stylization. In ECCV,

  52. [60]

    Local implicit normalizing flow for arbitrary-scale image super-resolution

    Jie-En Yao, Li-Yuan Tsao, Yi-Chen Lo, Roy Tseng, Chia- Che Chang, and Chun-Yi Lee. Local implicit normalizing flow for arbitrary-scale image super-resolution. In CVPR,

  53. [61]

    Scaling up to excellence: Practicing model scaling for photo- realistic image restoration in the wild

    Fanghua Yu, Jinjin Gu, Zheyuan Li, Jinfan Hu, Xiangtao Kong, Xintao Wang, Jingwen He, Yu Qiao, and Chao Dong. Scaling up to excellence: Practicing model scaling for photo- realistic image restoration in the wild. In CVPR, 2024. 3

    2024

  54. [62]

    Unsupervised image super- resolution using cycle-in-cycle generative adversarial net- works

    Yuan Yuan, Siyuan Liu, Jiawei Zhang, Yongbing Zhang, Chao Dong, and Liang Lin. Unsupervised image super- resolution using cycle-in-cycle generative adversarial net- works. In CVPRW, 2018. 3

    2018

  55. [63]

    Resshift: Efficient diffusion model for image super- resolution by residual shifting

    Zongsheng Yue, Jianyi Wang, and Chen Change Loy. Resshift: Efficient diffusion model for image super- resolution by residual shifting. In NeurIPS, 2024. 3, 5

    2024

  56. [64]

    Designing a practical degradation model for deep blind image super-resolution

    Kai Zhang, Jingyun Liang, Luc Van Gool, and Radu Timo- fte. Designing a practical degradation model for deep blind image super-resolution. In ICCV, 2021. 3, 5

    2021

  57. [65]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In CVPR, 2023. 3

    2023

  58. [66]

    The unreasonable effectiveness of deep features as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In CVPR, 2018. 5, 6, 8

    2018

  59. [67]

    Ranksrgan: Generative adversarial networks with ranker for image super-resolution

    Wenlong Zhang, Yihao Liu, Chao Dong, and Yu Qiao. Ranksrgan: Generative adversarial networks with ranker for image super-resolution. In ICCV, 2019. 3

    2019

  60. [68]

    Residual dense network for image super-resolution

    Yulun Zhang, Yapeng Tian, Yu Kong, Bineng Zhong, and Yun Fu. Residual dense network for image super-resolution. In CVPR, 2018. 2 10

    2018

  61. [69]

    Recognize anything: A strong image tagging model

    Youcai Zhang, Xinyu Huang, Jinyu Ma, Zhaoyang Li, Zhaochuan Luo, Yanchun Xie, Yuzhuo Qin, Tong Luo, Yaqian Li, Shilong Liu, et al. Recognize anything: A strong image tagging model. In CVPR, 2024. 1, 3

    2024

  62. [70]

    Scene parsing through ade20k dataset

    Bolei Zhou, Hang Zhao, Xavier Puig, Sanja Fidler, Adela Barriuso, and Antonio Torralba. Scene parsing through ade20k dataset. In CVPR, 2017. 5, 8 11

    2017

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.