Pith. sign in

REVIEW 3 major objections 5 minor 154 references

Visual-Instructed Degradation Diffusion for All-in-One Image Restoration

T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Defusion is a single diffusion model, guided by visual instructions built from degraded test charts, that operates on the residual between a low-quality image and its restored version; the paper reports it beats prior unified models on…

desk verdict A genuinely new visual-conditioning idea for all-in-one restoration, with a sound degradation-space diffusion core, but the paper's headline claims about unknown degradations rest on an unspecified oracle protocol and need revision. read the letter →

arxiv 2506.16960 v1 pith:WYXLNBC4 submitted 2025-06-20 cs.CV

Wenyang Luo , Haina Qin , Zewen Chen , Libin Wang , Dandan Zheng , Yuming Li , Yufan Liu , Bing Li
show 1 more author
Weiming Hu
This is my paper · ORCID
classification cs.CV
keywords all-in-oneimagerestorationvisualinstructiondegradationspacediffusionmodeldeblurringdehazingderainingdenoising
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper proposes Defusion, a single image-restoration model meant to handle many degradations at once: motion and defocus blur, haze, rain, raindrops, snow, noise, and JPEG artifacts. Its key move is to replace text prompts or learned task embeddings with a visual instruction: the same degradation applied to a standardized test chart built from textures, colors, and natural objects, so the model sees what the corruption looks like rather than reading a label. The diffusion process runs in 'degradation space', denoising the residual between the degraded image and its restored version instead of generating the image from scratch. On the reported benchmarks, the one model beats prior unified methods on every task and beats task-specific methods on several, including real-world and composite-degradation datasets. If the approach holds, a single restorer controlled by a visual description of its degradation is a practical step toward unknown and mixed degradations.

What carries the argument

The load-bearing object is the degradation space $\mathbb{D}_v$, defined as the set of differences $y_0 = x_{\mathrm{LQ}} - T_v(x_{\mathrm{LQ}})$ between a low-quality image and the restoration induced by a visual instruction $v$. Defusion adds Gaussian noise to this residual, trains a score model conditioned on $x_{\mathrm{LQ}}$ and $v$ to reverse that process, and returns $x_{\mathrm{LQ}} - \hat{y}_0$ as the restored image. The visual instruction is built by applying the degradation to a TE42-based visual ground (randomly assembled regular textures, random textures, standard colors, and natural objects), tokenized by a vector-quantized autoencoder, and injected through copied cross-attention layers (VIA); low-quality structure enters through an Image Restoration Bridge (IRB) that injects hierarchical features into each U-Net block via AdaLN-Zero.

What would settle it

Give Defusion an image whose degradation is not in the training families, such as a real photo combining motion blur, low light, and JPEG compression, run inference without supplying a visual instruction, and compare PSNR and LPIPS against task-specific restorers; if the gap is large or the output is not competitive, the all-in-one generalization claim collapses. As a second check, feed a deliberately mismatched instruction (a 'haze' chart on a blurry image) and verify the paper's claim that the model 'does nothing'—if it partially restores anyway, the controllability claim is falsified.

Watch

Extended reading notes

Core claim

Defusion's central claim is that guiding a diffusion model with a visual instruction—a standardized visual ground corrupted by the same degradation as the input image—and diffusing in the space of residuals between low-quality and high-quality images produces an all-in-one restorer that outperforms prior unified models across motion deblurring, defocus deblurring, desnowing, dehazing, raindrop removal, deraining, real denoising, and JPEG artifact removal, and that as a single model it even surpasses task-specific methods on several datasets. The paper further claims that the degradation-space formulation is more stable to train than image-space diffusion, that it imposes no special noise-schedule requirements and can therefore be adapted from any pretrained diffusion U-Net, and that it is controllable: when the visual instruction does not match the actual degradation, the model does nothing.

Load-bearing premise

At test time the method assumes you already know which degradation family the input image contains, because the visual instruction is built by applying that same family to a standard test chart; the paper gives no estimator that produces the instruction from an arbitrary unlabelled image.

Editorial extensions

If this is right

  • One trained model covers all eight tested tasks, and in the reported tables Defusion tops every unified baseline, beating task-specific models on several datasets as well.
  • The same model transfers to real-world and composite settings—NH-HAZE, LHP, RealSnow, RealBlur-J, a six-order rain–snow–noise mix, and underwater images—without task-specific fine-tuning.
  • Because the diffusion target is the LQ–HQ residual, the model preserves the low-quality structure and can be adapted from any pretrained diffusion U-Net without changing the noise schedule; the authors report stable training and fast DDIM sampling with four timesteps.
  • Diffusion in degradation space improves perceptual metrics (FID and LPIPS) relative to prior all-in-one diffusion restorers, as the generative prior from the pretrained U-Net is retained.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • I infer the evaluation protocol is oracle-guided: the supplement says the visual ground is augmented with 'the same category of degradation' as the input, so for an arbitrary image whose degradation is unknown the paper gives no rule for constructing the instruction; adding a learned instruction estimator is the natural step that would make the all-in-one claim fully blind.
  • I infer the visual-ground pool could double as a calibration set: an unlabelled LQ image could be compared against instructions built from each candidate degradation, letting the model select its own instruction at inference and turning the 'does nothing when mismatched' property into an active selector.
  • I infer the estimated residual $\hat{y}_0$ is itself a degradation map; if Defusion is right, that map could be reused for degradation segmentation, blind quality assessment, or synthesizing paired training data.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes Defusion, an all-in-one image restoration framework that conditions a diffusion model on "visual instructions": standardized TE42 charts that are degraded by the same corruption process as the input low-quality image. The instructions are tokenized by a VQ-GAN encoder and injected into a U-Net via a cross-attention adapter; the diffusion model operates in a "degradation space" defined as the difference between LQ and HQ images. The authors report state-of-the-art results on eight restoration tasks, on real-world datasets, on a synthesized mixed-distortion dataset, and on underwater images, and they claim generalization to unknown and composite degradations.

Significance. The degradation-space diffusion formulation (Eqs. 10-12) is coherent and the score-matching objective in Eq. (11) is standard. The idea of grounding degradations on standardized charts is interesting and could be a useful conditioning mechanism for multi-task restoration. The paper also provides extensive experiments and supplementary material, including perceptual metrics. However, the central claim—that Defusion is an all-in-one restorer for unknown, mixed, or real-world degradations—is not currently supported because the visual instruction at inference is constructed using the same degradation operator that generated the test LQ image. The ablation in Table 5 shows that the instruction is load-bearing (PSNR drops from 33.83 to 30.86 without it), so without a defined inference-time instruction-construction mechanism, the method is effectively an oracle-guided restorer on known degradation categories. The significance is therefore contingent on resolving this gap.

major comments (3)
  1. [Sec. 3.1 and Supplement Sec. 6] The paper does not provide any mechanism to construct the visual instruction v for an arbitrary input image at inference. The evaluation protocol uses the known test degradation category to build v; Supplement Sec. 6 states that "the visual ground is augmented with the same category of degradation as a visual instruction." This gives the model an oracle hint about the degradation type and parameters. Since v is the only task-selection signal (Table 5 shows a drop from 33.83 to 30.86 PSNR without it), the reported results do not support the abstract's claims of handling "unknown" or "real-world" degradations. The authors must either provide a practical estimator for v from the LQ image alone, or explicitly reframe the method as requiring a user-supplied instruction and adjust the claims accordingly.
  2. [Sec. 4.2, Tables 3 and 4] For the mixed-distortion WED dataset, the visual instruction must be constructed from the known composition order of rain/snow/noise, and for the underwater datasets EUVP and TURBID no instruction-construction protocol is described at all. The underwater images contain a degradation that is not one of the seven training categories, yet Table 4 reports results without explaining how v is obtained. Without this information, the generalization claims in the abstract and conclusion are not supported by the experiments.
  3. [Sec. 3.2] The property that the model "does nothing when v does not match the actual degradation" is asserted but the training objective in Eq. (11) does not include any term for mismatched instructions. There is no description of how the model is trained to output y0 = 0 (i.e., T_v(xLQ) = xLQ) for a wrong v. This is important because any practical inference-time estimator of v will be imperfect; the manuscript needs to specify how mismatched instructions are handled during training and what the expected behavior is at inference.
minor comments (5)
  1. [Table 1] The JPEG artifact removal (LIVE1) rows for AirNet, TransWeather, and WGWS-Net contain the same numbers as those methods' dehazing rows (e.g., AirNet 15.32/0.562, TransWeather 15.58/0.569, WGWS-Net 15.50/0.535), which appears to be a copy-paste error. Please verify and correct these entries.
  2. [Eq. (11)] The expectation subscript in Eq. (11) is written as x_t, but the variable being diffused is y_t; the subscript should be y_t to be consistent with the conditioning variables.
  3. [Sec. 4.1 and Supplement Sec. 8] The main text states that the model is trained for 100 epochs, while the supplement states 600K iterations; please clarify the relationship between these two statements.
  4. [Fig. 2 and Sec. 3.1] The figure caption refers to a loss L_inst, which is defined in Eq. (2) but stylized differently in the figure; please unify the notation.
  5. [Supplement Sec. 6] The supplement says the method takes "the residual between the visual ground and its degraded version," while Sec. 3.1 describes subtracting the clean visual ground embeddings from those of the degraded instruction; please clarify whether the residual is computed in image space or in the embedding space, and how this residual is injected into the diffusion model.

Circularity Check

1 steps flagged · score 6.0 of 10

Oracle-built visual instructions make the unknown-degradation claim circular.

  1. self definitional [Sec. 3.1 (Eqs. 9-10) and Supplementary Sec. 6]
    "Given an arbitrary degradation, we transform the visual ground by the degradation with random parameters. The degraded visual ground forms the visual instruction. ... For each degraded image that needs to be recovered, the visual ground is augmented with the same category of degradation as a visual instruction, either individually or as a mixed degradation category."

    The conditioning signal v is literally defined by applying the degradation to a chart, and the diffusion target is defined through that same v: Eq. (9) sets Dv = {xLQ - Tv(xLQ)} with Tv being the cleaner image for the degradation indicated by v, and Eq. (10) diffuses y0 = xLQ - Tv(xLQ). At inference, the supplement states that the visual ground is augmented with the same degradation category as the test LQ image. Therefore the model is never required to identify or estimate the degradation from the LQ; it is handed the answer key in the form of v. The claimed handling of unknown or mixed degradations is thus not derived from the LQ alone; the reported benchmark predictions reduce to oracle-conditioned restoration by construction.

full rationale

The diffusion objective and conditioning machinery (IRB, VIA, VQ tokenizer) are technically self-contained, and I found no load-bearing self-citations. However, the central all-in-one claim is undermined by the paper's own protocol: the visual instruction is constructed by applying the true degradation to a visual ground, and at inference the supplement confirms that the same degradation category as the LQ image is used. This makes the conditioning variable an oracle hint encoding the degradation to be removed. The benchmark tables therefore demonstrate conditional restoration with known task identity, not blind handling of unknown degradations. The degradation-space diffusion itself is an independent contribution, but as evaluated, the predictions reduce to oracle-guided restorations, which is a partial circularity in the claimed generalization result.

Assumptions & free parameters 4 free parameters · 5 assumptions · 1 invented entities

Everything the central claim rests on that a reader did not pay for upstream: the fidelity of chart-grounding as a proxy for natural image degradation, the availability of degradation knowledge at inference, the identity of the degradation operator between instruction and LQ image on synthetic benchmarks, and standard diffusion/VQ machinery. The free parameters are mostly the unreported distributions used to generate visual instructions, which must match the training/test degradations.

free parameters (4)
  • Visual instruction degradation parameter ranges = not reported
    Sec 3.1 says degradations are applied with 'random parameters' to visual grounds; the ranges (rain streak sizes, noise variance, haze density) are never given, yet they must align with the training/test degradations for the instruction to be informative.
  • Diffusion sampling timesteps = 4
    Sec 4.1 states 4 timesteps are used for all tasks without ablation; fidelity depends on this choice.
  • Clean-ground replacement probability = 0.1
    Sec 3.1 replaces the visual instruction with its clean ground with probability 0.1 during tokenizer training; chosen by hand.
  • VQ-GAN codebook size = 1024
    Embedding and tokenizer hyperparameters taken from the pretrained VQ-GAN implementation (Sec 8), not fitted by this paper; included for completeness since the degradation codes depend on it.
assumptions (5)
  • domain assumption Visual grounding: applying a degradation to a chart of basic visual elements (TE42) produces visual artifacts representative of the same degradation on natural images.
    Sec 3.1 and Fig 1; if grounded charts do not capture degradation appearance on natural content, the visual instruction cannot guide restoration.
  • ad hoc to paper At inference, a visual instruction matching the query image's degradation is available or can be constructed.
    No estimator or protocol is given in Sec 3 or Sec 4; all evaluations use benchmarks with known degradation families, so the instruction is effectively supplied by the test protocol.
  • ad hoc to paper For synthetic benchmarks, the degradation operator used to build the visual instruction is the same operator that generated the LQ image.
    Supplement Sec 6: 'the visual ground is augmented with the same category of degradation as a visual instruction'; this operator-identity assumption makes the instruction an oracle hint.
  • domain assumption The residual y0 = x_LQ - T_v(x_LQ) is well modeled by a conditional diffusion process with standard noise schedule.
    Eq. (10)-(11) assume Gaussian diffusion on residuals; the paper claims stability but provides no analysis of the residual distribution.
  • standard math Score matching (Eq. 8), DDIM sampling, and VQ-VAE training are valid background tools.
    Standard diffusion and discrete autoencoder machinery cited from [36,97,107,113].
invented entities (1)
  • Visual instruction tokens (degraded TE42 chart embeddings)
    purpose: Condition the diffusion U-Net to identify and remove the degradation present in the LQ image.
    The only evidence is the paper's own ablations and benchmarks; there is no externally validated measurement or falsifiable prediction beyond the reported performance, and no code release to allow independent reproduction.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Visual-Instructed Degradation Diffusion for All-in-One Image Restoration." pith.science (2026). https://pith.science/paper/WYXLNBC4

@misc{pith2026250616960,
  author       = {Pith},
  title        = {Pith review of: Visual-Instructed Degradation Diffusion for All-in-One Image Restoration},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WYXLNBC4}},
  note         = {Machine review of arXiv:2506.16960}
}
read the original abstract

Image restoration tasks like deblurring, denoising, and dehazing usually need distinct models for each degradation type, restricting their generalization in real-world scenarios with mixed or unknown degradations. In this work, we propose \textbf{Defusion}, a novel all-in-one image restoration framework that utilizes visual instruction-guided degradation diffusion. Unlike existing methods that rely on task-specific models or ambiguous text-based priors, Defusion constructs explicit \textbf{visual instructions} that align with the visual degradation patterns. These instructions are grounded by applying degradations to standardized visual elements, capturing intrinsic degradation features while agnostic to image semantics. Defusion then uses these visual instructions to guide a diffusion-based model that operates directly in the degradation space, where it reconstructs high-quality images by denoising the degradation effects with enhanced stability and generalizability. Comprehensive experiments demonstrate that Defusion outperforms state-of-the-art methods across diverse image restoration tasks, including complex and real-world degradations.

Figures

Figures reproduced from arXiv: 2506.16960 by the authors.

Figure 1
Figure 1. Visual instructions speak for visual degradations. Vi [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Framework of the proposed method. 1) Visual instructions are constructed from visual grounds to demonstrate the visual effects [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Visual results on dehazing, draining, and deblurring on synthetic datasets . [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (8 more)
Figure 4
Figure 4. Figure 4: Real-world visual results on desnowing and deblurring. [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 6
Figure 6. Figure 6: Samples of visually degraded elements from the pool of [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]
Figure 7
Figure 7. Figure 7: Details of visual ground. Visual Ground Visual Instruct Blur Haze Noise Visual Ground Haze Snow Rain Visual Instruct [PITH_FULL_IMAGE:figures/full_fig_p016_7.png]
Figure 8
Figure 8. Figure 8: Samples of visual instruct. • Image Dehazing: collected from RESIDE [49] dataset containing 12591 training images, and Dense-Haze [6] dataset containing 49 and 6 training and testing images. • Raindrop Removal: collected from RainDrop [87] dataset containing 861 and 30…
Figure 9
Figure 9. Figure 9: Samples of Datasets. downsamples the input size by a factor of two. The decoder is symmetric to the encoder. The visual instruct tokenizer is trained by the combination of vector quantization (VQ) loss and a reconstruction loss described by Eqs. (2) to (4), where λ = 1…
Figure 10
Figure 10. Figure 10: Visual results of real-world datasets. Figures 10 to 12 provide more visualization results on the all-in-one synthesized/real-world/mixed-degradation datasets [PITH_FULL_IMAGE:figures/full_fig_p019_10.png]
Figure 11
Figure 11. Figure 11: Visual results of synthesized datasets. Snow>Noise>Rain Input Output Reference Snow>Rain>Noise Noise>Snow>Rain Noise>Rain>Snow Rain>Snow>Noise Rain>Noise>Snow [PITH_FULL_IMAGE:figures/full_fig_p020_11.png]
Figure 12
Figure 12. Figure 12: Visual results of mix distortion datasets. [PITH_FULL_IMAGE:figures/full_fig_p020_12.png]

Review history (2 revisions) →

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

154 extracted references · 43 canonical work pages

  1. [1]

    A high-quality denoising dataset for smartphone cameras

    Abdelrahman Abdelhamed, Stephen Lin, and Michael S Brown. A high-quality denoising dataset for smartphone cameras. InProceedings of the IEEE conference on com- puter vision and pattern recognition, pages 1692–1700,

  2. [2]

    Defocus de- blurring using dual-pixel data

    Abdullah Abuolaim and Michael S Brown. Defocus de- blurring using dual-pixel data. InComputer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part X 16, pages 111–126. Springer, 2020. 5, 6, 1, 3

    2020

  3. [3]

    Ntire 2017 challenge on single image super-resolution: Dataset and study

    Eirikur Agustsson and Radu Timofte. Ntire 2017 challenge on single image super-resolution: Dataset and study. InThe IEEE Conference on Computer Vision and Pattern Recog- nition (CVPR) Workshops, 2017. 2

    2017

  4. [4]

    Multimodal prompt perceiver: Empower adap- tiveness generalizability and fidelity for all-in-one image restoration

    Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, and Ran He. Multimodal prompt perceiver: Empower adap- tiveness generalizability and fidelity for all-in-one image restoration. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 25432– 25444, 2024. 1, 2, 3, 4, 5, 6, 7

    2024

  5. [5]

    Flamingo: a visual language model for few-shot learning

    Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, An- toine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al. Flamingo: a visual language model for few-shot learning. Advances in neural information processing systems, 35: 23716–23736, 2022. 4

    2022

  6. [6]

    Dense-haze: A benchmark for image dehazing with dense-haze and haze-free images

    Codruta O Ancuti, Cosmin Ancuti, Mateu Sbert, and Radu Timofte. Dense-haze: A benchmark for image dehazing with dense-haze and haze-free images. In2019 IEEE in- ternational conference on image processing (ICIP), pages 1014–1018. IEEE, 2019. 5, 6, 2

    2019

  7. [7]

    Nh-haze: An image dehazing benchmark with non- homogeneous hazy and haze-free images

    Codruta O Ancuti, Cosmin Ancuti, and Radu Timo- fte. Nh-haze: An image dehazing benchmark with non- homogeneous hazy and haze-free images. InProceedings of the IEEE/CVF conference on computer vision and pat- tern recognition workshops, pages 444–445, 2020. 5, 7

    2020

  8. [8]

    Real image denoising with feature attention

    Saeed Anwar and Nick Barnes. Real image denoising with feature attention. InProceedings of the IEEE/CVF inter- national conference on computer vision, pages 3155–3164,

Show all 154 references
  1. [9]

    Self-guided image dehazing using progressive feature fu- sion.IEEE Transactions on Image Processing, 31:1217– 1229, 2022

    Haoran Bai, Jinshan Pan, Xinguang Xiang, and Jinhui Tang. Self-guided image dehazing using progressive feature fu- sion.IEEE Transactions on Image Processing, 31:1217– 1229, 2022. 7

    2022

  2. [10]

    Visual prompting via image inpaint- ing.Advances in Neural Information Processing Systems, 35:25005–25017, 2022

    Amir Bar, Yossi Gandelsman, Trevor Darrell, Amir Glober- son, and Alexei Efros. Visual prompting via image inpaint- ing.Advances in Neural Information Processing Systems, 35:25005–25017, 2022. 3

    2022

  3. [11]

    Estimating or propagating gradients through stochastic neurons for conditional computation.arXiv preprint arXiv:1308.3432, 2013

    Yoshua Bengio, Nicholas L ´eonard, and Aaron Courville. Estimating or propagating gradients through stochastic neurons for conditional computation.arXiv preprint arXiv:1308.3432, 2013. 4

    2013 arXiv

  4. [12]

    In- structpix2pix: Learning to follow image editing instruc- tions

    Tim Brooks, Aleksander Holynski, and Alexei A Efros. In- structpix2pix: Learning to follow image editing instruc- tions. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18392– 18402, 2023. 3, 5

    2023

  5. [13]

    Lion: Empowering multimodal large language model with dual-level visual knowledge

    Gongwei Chen, Leyang Shen, Rui Shao, Xiang Deng, and Liqiang Nie. Lion: Empowering multimodal large language model with dual-level visual knowledge. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 26540–26550, 2024. 1

    2024

  6. [14]

    Pre-trained image processing transformer

    Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yip- ing Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, and Wen Gao. Pre-trained image processing transformer. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12299–12310, 2021. 1

    2021

  7. [15]

    Simple baselines for image restoration

    Liangyu Chen, Xiaojie Chu, Xiangyu Zhang, and Jian Sun. Simple baselines for image restoration. InEuropean con- ference on computer vision, pages 17–33. Springer, 2022. 2, 6, 7, 8

    2022

  8. [16]

    Sparse sampling transformer with uncertainty-driven ranking for unified removal of raindrops and rain streaks

    Sixiang Chen, Tian Ye, Jinbin Bai, Erkang Chen, Jun Shi, and Lei Zhu. Sparse sampling transformer with uncertainty-driven ranking for unified removal of raindrops and rain streaks. InProceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 13106– 13117,...

    2023

  9. [17]

    Learning a sparse transformer network for effective image deraining

    Xiang Chen, Hao Li, Mingqiang Li, and Jinshan Pan. Learning a sparse transformer network for effective image deraining. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5896– 5905, 2023. 1, 6, 7, 3

    2023

  10. [18]

    Rethinking coarse-to-fine ap- proach in single image deblurring

    Sung-Jin Cho, Seo-Won Ji, Jun-Pyo Hong, Seung-Won Jung, and Sung-Jea Ko. Rethinking coarse-to-fine ap- proach in single image deblurring. InProceedings of the IEEE/CVF international conference on computer vision, pages 4641–4650, 2021. 6

    2021

  11. [19]

    In- structir: High-quality image restoration following human instructions.arXiv preprint arXiv:2401.16468, 2(4), 2024

    Marcos V Conde, Gregor Geigle, and Radu Timofte. In- structir: High-quality image restoration following human instructions.arXiv preprint arXiv:2401.16468, 2(4), 2024. 1, 2, 3

    2024 arXiv

  12. [20]

    Diffedit: Diffusion-based seman- tic image editing with mask guidance.arXiv preprint arXiv:2210.11427, 2022

    Guillaume Couairon, Jakob Verbeek, Holger Schwenk, and Matthieu Cord. Diffedit: Diffusion-based seman- tic image editing with mask guidance.arXiv preprint arXiv:2210.11427, 2022. 3

    2022 arXiv

  13. [21]

    Focal network for image restoration

    Yuning Cui, Wenqi Ren, Xiaochun Cao, and Alois Knoll. Focal network for image restoration. InProceedings of the IEEE/CVF international conference on computer vi- sion, pages 13001–13011, 2023. 6, 3

    2023

  14. [22]

    Diffusion models beat gans on image synthesis.Advances in neural informa- tion processing systems, 34:8780–8794, 2021

    Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans on image synthesis.Advances in neural informa- tion processing systems, 34:8780–8794, 2021. 2, 6, 4

    2021

  15. [23]

    Restoration by generation with constrained priors

    Zheng Ding, Xuaner Zhang, Zhuowen Tu, and Zhihao Xia. Restoration by generation with constrained priors. InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2567–2577, 2024. 2

    2024

  16. [24]

    A dataset to evaluate underwater image restoration methods

    Amanda Duarte, Felipe Codevilla, Joel De O Gaya, and Sil- via SC Botelho. A dataset to evaluate underwater image restoration methods. InOCEANS 2016-Shanghai, pages 1–

    2016

  17. [25]

    Quantization guided jpeg artifact correction

    Max Ehrlich, Larry Davis, Ser-Nam Lim, and Abhinav Shrivastava. Quantization guided jpeg artifact correction. InComputer Vision–ECCV 2020: 16th European Confer- ence, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII 16, pages 293–309. Springer, 2020. 1, 6

    2020

  18. [26]

    TE42.https://www.image- engineering.de/products/charts/all/425- te42, 2024

    Image Engineering. TE42.https://www.image- engineering.de/products/charts/all/425- te42, 2024. [Online; accessed 19-October-2024]. 4, 1

    2024

  19. [27]

    Taming transformers for high-resolution image synthesis

    Patrick Esser, Robin Rombach, and Bjorn Ommer. Taming transformers for high-resolution image synthesis. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12873–12883, 2021. 4, 3

    2021

  20. [28]

    A robust non-blind deblurring method using deep de- noiser prior.2022 IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition Workshops (CVPRW), pages 734–743, 2022

    Yingying Fang, Hao Zhang, Hok Shing Wong, and Tieyong Zeng. A robust non-blind deblurring method using deep de- noiser prior.2022 IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition Workshops (CVPRW), pages 734–743, 2022. 2

    2022

  21. [29]

    Layoutgpt: Compositional vi- sual planning and generation with large language models

    Weixi Feng, Wanrong Zhu, Tsu-jui Fu, Varun Jampani, Arjun Akula, Xuehai He, Sugato Basu, Xin Eric Wang, and William Yang Wang. Layoutgpt: Compositional vi- sual planning and generation with large language models. Advances in Neural Information Processing Systems, 36,

  22. [30]

    Removing rain from single images via a deep detail network

    Xueyang Fu, Jiabin Huang, Delu Zeng, Yue Huang, Xing- hao Ding, and John Paisley. Removing rain from single images via a deep detail network. InProceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 3855–3863, 2017. 5, 6, 2, 3

    2017

  23. [31]

    Image dehazing transformer with transmission-aware 3d position embedding.2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5802–5810, 2022

    Chunle Guo, Qixin Yan, Saeed Anwar, Runmin Cong, Wenqi Ren, and Chongyi Li. Image dehazing transformer with transmission-aware 3d position embedding.2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5802–5810, 2022. 2

    2022

  24. [32]

    Image dehazing transformer with transmission-aware 3d position embedding

    Chun-Le Guo, Qixin Yan, Saeed Anwar, Runmin Cong, Wenqi Ren, and Chongyi Li. Image dehazing transformer with transmission-aware 3d position embedding. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5812–5820, 2022. 6, 7

    2022

  25. [33]

    From sky to the ground: A large-scale bench- mark and simple baseline towards real rain removal

    Yun Guo, Xueyao Xiao, Yi Chang, Shumin Deng, and Luxin Yan. From sky to the ground: A large-scale bench- mark and simple baseline towards real rain removal. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 12097–12107, 2023. 5, 7, 2

    2023

  26. [34]

    Onerestore: A universal restora- tion framework for composite degradation.arXiv preprint arXiv:2407.04621, 2024

    Yu Guo, Yuan Gao, Yuxu Lu, Huilin Zhu, Ryan Wen Liu, and Shengfeng He. Onerestore: A universal restora- tion framework for composite degradation.arXiv preprint arXiv:2407.04621, 2024. 2

    2024 arXiv

  27. [35]

    Gans trained by a two time-scale update rule converge to a local nash equi- librium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equi- librium. InNeural Information Processing Systems, 2017. 4

    2017

  28. [36]

    Denoising dif- fusion probabilistic models.Advances in neural informa- tion processing systems, 33:6840–6851, 2020

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models.Advances in neural informa- tion processing systems, 33:6840–6851, 2020. 2, 4

    2020

  29. [37]

    Memory uncer- tainty learning for real-world single image deraining.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3446–3460, 2022

    Huaibo Huang, Mandi Luo, and Ran He. Memory uncer- tainty learning for real-world single image deraining.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3446–3460, 2022. 7

    2022

  30. [38]

    Composer: Creative and controllable im- age synthesis with composable conditions.arXiv preprint arXiv:2302.09778, 2023

    Lianghua Huang, Di Chen, Yu Liu, Yujun Shen, Deli Zhao, and Jingren Zhou. Composer: Creative and controllable im- age synthesis with composable conditions.arXiv preprint arXiv:2302.09778, 2023. 3

    2023 arXiv

  31. [39]

    Fast un- derwater image enhancement for improved visual percep- tion.IEEE Robotics and Automation Letters, 5(2):3227– 3234, 2020

    Md Jahidul Islam, Youya Xia, and Junaed Sattar. Fast un- derwater image enhancement for improved visual percep- tion.IEEE Robotics and Automation Letters, 5(2):3227– 3234, 2020. 5, 8, 3

    2020

  32. [40]

    Image-to-image translation with conditional adver- sarial networks

    Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. Image-to-image translation with conditional adver- sarial networks. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 1125–1134,

  33. [41]

    Towards flex- ible blind jpeg artifacts removal

    Jiaxi Jiang, Kai Zhang, and Radu Timofte. Towards flex- ible blind jpeg artifacts removal. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 4997–5006, 2021. 1

    2021

  34. [42]

    Multi-scale progressive fusion network for single image deraining

    Kui Jiang, Zhongyuan Wang, Peng Yi, Chen Chen, Baojin Huang, Yimin Luo, Jiayi Ma, and Junjun Jiang. Multi-scale progressive fusion network for single image deraining. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 8346–8355, 2020. 1

    2020

  35. [43]

    Autodir: Automatic all-in-one image restoration with latent diffusion.arXiv preprint arXiv:2310.10123, 2023

    Yitong Jiang, Zhaoyang Zhang, Tianfan Xue, and Jinwei Gu. Autodir: Automatic all-in-one image restoration with latent diffusion.arXiv preprint arXiv:2310.10123, 2023. 1, 2, 3, 4, 5

    2023 arXiv

  36. [44]

    Li, Chunle Guo, Zhi Chai, and Chongyi Li

    Xin Jin, Linghao Han, Z. Li, Chunle Guo, Zhi Chai, and Chongyi Li. Dnf: Decouple and feedback network for see- ing in the dark.2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 18135– 18144, 2023. 2

    2023

  37. [45]

    Denoising diffusion restoration models.Advances in Neural Information Processing Systems, 35:23593–23606,

    Bahjat Kawar, Michael Elad, Stefano Ermon, and Jiaming Song. Denoising diffusion restoration models.Advances in Neural Information Processing Systems, 35:23593–23606,

  38. [46]

    Variational diffusion models.Advances in neural in- formation processing systems, 34:21696–21707, 2021

    Diederik Kingma, Tim Salimans, Ben Poole, and Jonathan Ho. Variational diffusion models.Advances in neural in- formation processing systems, 34:21696–21707, 2021. 4

    2021

  39. [47]

    Auto-encoding variational bayes

    Diederik P Kingma. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013. 2

    2013 arXiv

  40. [48]

    Adam: A method for stochastic opti- mization.arXiv preprint arXiv:1412.6980, 2014

    Diederik P Kingma. Adam: A method for stochastic opti- mization.arXiv preprint arXiv:1412.6980, 2014. 6, 4

    2014 arXiv

  41. [49]

    Benchmark- ing single-image dehazing and beyond.IEEE Transactions on Image Processing, 28(1):492–505, 2018

    Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. Benchmark- ing single-image dehazing and beyond.IEEE Transactions on Image Processing, 28(1):492–505, 2018. 5, 2

    2018

  42. [50]

    All-in-one image restoration for unknown corruption

    Boyun Li, Xiao Liu, Peng Hu, Zhongqin Wu, Jiancheng Lv, and Xi Peng. All-in-one image restoration for unknown corruption. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 17452– 17462, 2022. 6, 7, 3

    2022

  43. [51]

    Promptcir: Blind compressed image restoration with prompt learning.arXiv preprint arXiv:2404.17433, 2024

    Bingchen Li, Xin Li, Yiting Lu, Ruoyu Feng, Mengxi Guo, Shijie Zhao, Li Zhang, and Zhibo Chen. Promptcir: Blind compressed image restoration with prompt learning.arXiv preprint arXiv:2404.17433, 2024. 2

    2024 arXiv

  44. [52]

    Embedding fourier for ultra-high-definition low-light im- age enhancement.ArXiv, abs/2302.11831, 2023

    Chongyi Li, Chunle Guo, Man Zhou, Zhexin Liang, Shangchen Zhou, Ruicheng Feng, and Chen Change Loy. Embedding fourier for ultra-high-definition low-light im- age enhancement.ArXiv, abs/2302.11831, 2023. 2

    2023 arXiv

  45. [53]

    Learning degradation representations for image deblurring

    Dasong Li, Yi Zhang, Ka Chun Cheung, Xiaogang Wang, Hongwei Qin, and Hongsheng Li. Learning degradation representations for image deblurring. InEuropean confer- ence on computer vision, pages 736–753. Springer, 2022. 2

    2022

  46. [54]

    Heavy rain image restoration: Integrating physics model and conditional adversarial learning

    Ruoteng Li, Loong-Fah Cheong, and Robby T Tan. Heavy rain image restoration: Integrating physics model and conditional adversarial learning. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1633–1642, 2019. 5, 2

    2019

  47. [55]

    Gligen: Open-set grounded text-to-image generation

    Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee. Gligen: Open-set grounded text-to-image generation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22511–22521, 2023. 3

    2023

  48. [56]

    Llm- grounded diffusion: Enhancing prompt understanding of text-to-image diffusion models with large language models

    Long Lian, Boyi Li, Adam Yala, and Trevor Darrell. Llm- grounded diffusion: Enhancing prompt understanding of text-to-image diffusion models with large language models. arXiv preprint arXiv:2305.13655, 2023. 3

    2023 arXiv

  49. [57]

    Swinir: Image restoration using swin transformer

    Jingyun Liang, Jiezhang Cao, Guolei Sun, Kai Zhang, Luc Van Gool, and Radu Timofte. Swinir: Image restoration using swin transformer. InProceedings of the IEEE/CVF international conference on computer vision, pages 1833– 1844, 2021. 2

    2021

  50. [58]

    Drt: A lightweight single image deraining recursive transformer

    Yuanchu Liang, Saeed Anwar, and Yang Liu. Drt: A lightweight single image deraining recursive transformer. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 589–598, 2022. 6, 3

    2022

  51. [59]

    Diffbir: Towards blind image restoration with generative diffusion prior.arXiv preprint arXiv:2308.15070, 2023

    Xinqi Lin, Jingwen He, Ziyan Chen, Zhaoyang Lyu, Bo Dai, Fanghua Yu, Wanli Ouyang, Yu Qiao, and Chao Dong. Diffbir: Towards blind image restoration with generative diffusion prior.arXiv preprint arXiv:2308.15070, 2023. 1, 2, 3, 4, 5

    2023 arXiv

  52. [60]

    Unsupervised image denoising in real-world scenarios via self-collaboration parallel generative adversarial branches

    Xin Yu Lin, Chao Ren, Xiao Liu, Jie Huang, and Yinjie Lei. Unsupervised image denoising in real-world scenarios via self-collaboration parallel generative adversarial branches. 2023 IEEE/CVF International Conference on Computer Vi- sion (ICCV), pages 12608–12618, 2023. 2

    2023

  53. [61]

    Visual instruction tuning.Advances in neural infor- mation processing systems, 36, 2024

    Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning.Advances in neural infor- mation processing systems, 36, 2024. 4

    2024

  54. [62]

    Structure matters: Tackling the semantic dis- crepancy in diffusion models for image inpainting

    Haipeng Liu, Yang Wang, Biao Qian, Meng Wang, and Yong Rui. Structure matters: Tackling the semantic dis- crepancy in diffusion models for image inpainting. InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8038–8047, 2024. 2

    2024

  55. [63]

    Residual denoising diffu- sion models

    Jiawei Liu, Qiang Wang, Huijie Fan, Yinong Wang, Yan- dong Tang, and Liangqiong Qu. Residual denoising diffu- sion models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2773– 2783, 2024. 2, 5

    2024

  56. [64]

    Griddehazenet: Attention-based multi-scale network for image dehazing

    Xiaohong Liu, Yongrui Ma, Zhihao Shi, and Jun Chen. Griddehazenet: Attention-based multi-scale network for image dehazing. InProceedings of the IEEE/CVF inter- national conference on computer vision, pages 7314–7323,

  57. [65]

    Diff-plugin: Revitalizing details for diffusion-based low-level tasks

    Yuhao Liu, Zhanghan Ke, Fang Liu, Nanxuan Zhao, and Rynson WH Lau. Diff-plugin: Revitalizing details for diffusion-based low-level tasks. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4197–4208, 2024. 1, 2

    2024

  58. [66]

    Mmbench: Is your multi- modal model an all-around player? InEuropean Confer- ence on Computer Vision, pages 216–233

    Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, Conghui He, Ziwei Liu, et al. Mmbench: Is your multi- modal model an all-around player? InEuropean Confer- ence on Computer Vision, pages 216–233. Springer, 2025. 1

    2025

  59. [67]

    Desnownet: Context-aware deep network for snow removal.IEEE Transactions on Image Processing, 27(6): 3064–3073, 2018

    Yun-Fu Liu, Da-Wei Jaw, Shih-Chia Huang, and Jenq-Neng Hwang. Desnownet: Context-aware deep network for snow removal.IEEE Transactions on Image Processing, 27(6): 3064–3073, 2018. 5, 6, 1, 3

    2018

  60. [68]

    Decoupled weight decay regularization.arXiv preprint arXiv:1711.05101, 2017

    I Loshchilov. Decoupled weight decay regularization.arXiv preprint arXiv:1711.05101, 2017. 4

    2017 arXiv

  61. [69]

    Sgdr: Stochastic gradient descent with warm restarts.arXiv preprint arXiv:1608.03983, 2016

    Ilya Loshchilov and Frank Hutter. Sgdr: Stochastic gradient descent with warm restarts.arXiv preprint arXiv:1608.03983, 2016. 6, 4

    2016 arXiv

  62. [70]

    Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps

    Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongx- uan Li, and Jun Zhu. Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps. Advances in Neural Information Processing Systems, 35: 5775–5787, 2022. 4

    2022

  63. [71]

    Controlling vision- language models for universal image restoration.arXiv preprint arXiv:2310.01018, 3(8), 2023

    Ziwei Luo, Fredrik K Gustafsson, Zheng Zhao, Jens Sj¨olund, and Thomas B Sch ¨on. Controlling vision- language models for universal image restoration.arXiv preprint arXiv:2310.01018, 3(8), 2023. 6, 3

    2023 arXiv

  64. [72]

    Image restoration with mean-reverting stochastic differential equations.arXiv preprint arXiv:2301.11699, 2023

    Ziwei Luo, Fredrik K Gustafsson, Zheng Zhao, Jens Sj¨olund, and Thomas B Sch ¨on. Image restoration with mean-reverting stochastic differential equations.arXiv preprint arXiv:2301.11699, 2023. 2

    2023 arXiv

  65. [73]

    Refusion: Enabling large- size realistic image restoration with latent-space diffusion models

    Ziwei Luo, Fredrik K Gustafsson, Zheng Zhao, Jens Sj¨olund, and Thomas B Sch ¨on. Refusion: Enabling large- size realistic image restoration with latent-space diffusion models. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1680–1691,

  66. [74]

    Prores: Explor- ing degradation-aware visual prompt for universal image restoration.arXiv preprint arXiv:2306.13653, 2023

    Jiaqi Ma, Tianheng Cheng, Guoli Wang, Qian Zhang, Xinggang Wang, and Lefei Zhang. Prores: Explor- ing degradation-aware visual prompt for universal image restoration.arXiv preprint arXiv:2306.13653, 2023. 2

    2023 arXiv

  67. [75]

    Waterloo exploration database: New challenges for image quality as- sessment models.IEEE Transactions on Image Processing, 26(2):1004–1016, 2016

    Kede Ma, Zhengfang Duanmu, Qingbo Wu, Zhou Wang, Hongwei Yong, Hongliang Li, and Lei Zhang. Waterloo exploration database: New challenges for image quality as- sessment models.IEEE Transactions on Image Processing, 26(2):1004–1016, 2016. 5, 2

    2016

  68. [76]

    Sen- sitivity decouple learning for image compression artifacts reduction.IEEE Transactions on Image Processing, 2024

    Li Ma, Yifan Zhao, Peixi Peng, and Yonghong Tian. Sen- sitivity decouple learning for image compression artifacts reduction.IEEE Transactions on Image Processing, 2024. 6

    2024

  69. [77]

    No-reference image quality assessment in the spatial domain.IEEE Transactions on image processing, 21(12): 4695–4708, 2012

    Anish Mittal, Anush Krishna Moorthy, and Alan Conrad Bovik. No-reference image quality assessment in the spatial domain.IEEE Transactions on image processing, 21(12): 4695–4708, 2012. 4, 1

    2012

  70. [78]

    completely blind

    Anish Mittal, Rajiv Soundararajan, and Alan C Bovik. Making a “completely blind” image quality analyzer.IEEE Signal processing letters, 20(3):209–212, 2012. 4, 1

    2012

  71. [79]

    Detailclip: Detail-oriented clip for fine-grained tasks.arXiv preprint arXiv:2409.06809, 2024

    Amin Karimi Monsefi, Kishore Prakash Sailaja, Ali Alilooee, Ser-Nam Lim, and Rajiv Ramnath. Detailclip: Detail-oriented clip for fine-grained tasks.arXiv preprint arXiv:2409.06809, 2024. 4

    2024 arXiv

  72. [80]

    T2i-adapter: Learn- ing adapters to dig out more controllable ability for text-to- image diffusion models

    Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, and Ying Shan. T2i-adapter: Learn- ing adapters to dig out more controllable ability for text-to- image diffusion models. InProceedings of the AAAI Con- ference on Artificial Intelligence, pages 4296–4304...

    2024

  73. [81]

    Deep multi-scale convolutional neural network for dynamic scene deblurring

    Seungjun Nah, Tae Hyun Kim, and Kyoung Mu Lee. Deep multi-scale convolutional neural network for dynamic scene deblurring. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 3883–3891,

  74. [82]

    Visual instruction inversion: Image editing via im- age prompting.Advances in Neural Information Processing Systems, 36, 2024

    Thao Nguyen, Yuheng Li, Utkarsh Ojha, and Yong Jae Lee. Visual instruction inversion: Image editing via im- age prompting.Advances in Neural Information Processing Systems, 36, 2024. 3

    2024

  75. [83]

    Restoring vision in adverse weather conditions with patch-based denoising diffusion models.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(8):10346–10357, 2023

    Ozan ¨Ozdenizci and Robert Legenstein. Restoring vision in adverse weather conditions with patch-based denoising diffusion models.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(8):10346–10357, 2023. 6, 8, 3

    2023

  76. [84]

    All- in-one image restoration for unknown degradations using adaptive discriminative filters for specific degradations

    Dongwon Park, Byung Hyun Lee, and Se Young Chun. All- in-one image restoration for unknown degradations using adaptive discriminative filters for specific degradations. In 2023 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 5815–5824. IEEE, 2023...

    2023

  77. [85]

    Scalable diffusion mod- els with transformers

    William Peebles and Saining Xie. Scalable diffusion mod- els with transformers. InProceedings of the IEEE/CVF In- ternational Conference on Computer Vision, pages 4195– 4205, 2023. 5

    2023

  78. [86]

    Promptir: Prompting for all- in-one image restoration.Advances in Neural Information Processing Systems, 36, 2024

    Vaishnav Potlapalli, Syed Waqas Zamir, Salman H Khan, and Fahad Shahbaz Khan. Promptir: Prompting for all- in-one image restoration.Advances in Neural Information Processing Systems, 36, 2024. 1, 2, 3, 6, 8

    2024

  79. [87]

    Attentive generative adversarial network for rain- drop removal from a single image

    Rui Qian, Robby T Tan, Wenhan Yang, Jiajun Su, and Jiay- ing Liu. Attentive generative adversarial network for rain- drop removal from a single image. InProceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 2482–2491, 2018. 5, 6, 2, 3

    2018

  80. [88]

    Restore anything with masks: Leveraging mask image modeling for blind all- in-one image restoration.arXiv preprint arXiv:2409.19403,

    Chu-Jie Qin, Rui-Qi Wu, Zikun Liu, Xin Lin, Chun-Le Guo, Hyun Hee Park, and Chongyi Li. Restore anything with masks: Leveraging mask image modeling for blind all- in-one image restoration.arXiv preprint arXiv:2409.19403,

    arXiv

  81. [89]

    Mb-taylorformer: Multi-branch efficient transformer expanded by taylor formula for im- age dehazing

    Yuwei Qiu, Kaihao Zhang, Chenxi Wang, Wenhan Luo, Hongdong Li, and Zhi Jin. Mb-taylorformer: Multi-branch efficient transformer expanded by taylor formula for im- age dehazing. InProceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 12802– 12813, 2023. 6, 7

    2023

  82. [90]

    Remov- ing raindrops and rain streaks in one go

    Ruijie Quan, Xin Yu, Yuanzhi Liang, and Yi Yang. Remov- ing raindrops and rain streaks in one go. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9147–9156, 2021. 5, 2

    2021

  83. [91]

    Deep learning for seeing through window with raindrops

    Yuhui Quan, Shijie Deng, Yixin Chen, and Hui Ji. Deep learning for seeing through window with raindrops. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2463–2471, 2019. 6, 3

    2019

  84. [92]

    Neumann network with recursive kernels for single image defocus deblurring

    Yuhui Quan, Zicong Wu, and Hui Ji. Neumann network with recursive kernels for single image defocus deblurring. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5754–5763, 2023. 6, 3

    2023

  85. [93]

    Learn- ing transferable visual models from natural language super- vision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learn- ing transferable visual models from natural language super- vision. InInternational conference on machine learning,...

    2021

  86. [94]

    Hierarchical text-conditional image generation with clip latents.arXiv preprint arXiv:2204.06125, 2022

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image generation with clip latents.arXiv preprint arXiv:2204.06125, 2022. 3

    2022 arXiv

  87. [95]

    Adaptive consistency prior based deep network for image denoising

    Chao Ren, Xiaohai He, Chuncheng Wang, and Zhibo Zhao. Adaptive consistency prior based deep network for image denoising. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8596–8606,

  88. [96]

    Real-world blur dataset for learning and bench- marking deblurring algorithms

    Jaesung Rim, Haeyun Lee, Jucheol Won, and Sunghyun Cho. Real-world blur dataset for learning and bench- marking deblurring algorithms. InComputer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXV 16, pages 184–201. Springer, 202...

    2020

  89. [97]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 2, 3, 4

    2022

  90. [98]

    U- net: Convolutional networks for biomedical image segmen- tation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. InMedical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, par...

    2015

  91. [99]

    Learning to deblur using light field generated and real de- focus images

    Lingyan Ruan, Bin Chen, Jizhou Li, and Miuling Lam. Learning to deblur using light field generated and real de- focus images. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16304– 16313, 2022. 6, 3

    2022

  92. [100]

    Im- agenet large scale visual recognition challenge.Interna- tional journal of computer vision, 115:211–252, 2015

    Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, et al. Im- agenet large scale visual recognition challenge.Interna- tional journal of computer vision, 115:211–252, 2015. 3

    2015

  93. [101]

    Photorealistic text-to-image diffusion models with deep language understanding.Advances in neural in- formation processing systems, 35:36479–36494, 2022

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Sali- mans, et al. Photorealistic text-to-image diffusion models with deep language understanding.Advances in neural in- format...

    2022

  94. [102]

    Laion-5b: An open large-scale dataset for train- ing next generation image-text models.Advances in Neural Information Processing Systems, 35:25278–25294, 2022

    Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Worts- man, et al. Laion-5b: An open large-scale dataset for train- ing next generation image-text models.Advances in Neural Info...

    2022

  95. [103]

    Investigating the limitation of clip models: The worst-performing categories.arXiv preprint arXiv:2310.03324, 2023

    Jie-Jing Shao, Jiang-Xin Shi, Xiao-Wen Yang, Lan-Zhe Guo, and Yu-Feng Li. Investigating the limitation of clip models: The worst-performing categories.arXiv preprint arXiv:2310.03324, 2023. 4

    2023 arXiv

  96. [104]

    Live image quality assessment database release 2.http://live

    H Sheikh. Live image quality assessment database release 2.http://live. ece. utexas. edu/research/quality, 2005. 5, 6, 2

    2005

  97. [105]

    Resfusion: Denoising diffusion probabilistic models for image restoration based on prior residual noise

    Zhenning Shi, Haoshuai Zheng, Chen Xu, Changsheng Dong, Bin Pan, Xueshuo Xie, Along He, Tao Li, and Huazhu Fu. Resfusion: Denoising diffusion probabilistic models for image restoration based on prior residual noise. arXiv e-prints, pages arXiv–2311, 2023. 2, 5

    2023

  98. [106]

    Deep unsupervised learning using nonequilibrium thermodynamics

    Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. InInternational confer- ence on machine learning, pages 2256–2265. PMLR, 2015. 2

    2015

  99. [107]

    Denoising diffusion implicit models.arXiv preprint arXiv:2010.02502, 2020

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models.arXiv preprint arXiv:2010.02502, 2020. 6

    2010 arXiv

  100. [108]

    Score- based generative modeling through stochastic differential equations.arXiv preprint arXiv:2011.13456, 2020

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score- based generative modeling through stochastic differential equations.arXiv preprint arXiv:2011.13456, 2020. 2, 4

    2011 arXiv

  101. [109]

    Vision transformers for single image dehazing.IEEE Transactions on Image Processing, 32:1927–1941, 2023

    Yuda Song, Zhuqing He, Hui Qian, and Xin Du. Vision transformers for single image dehazing.IEEE Transactions on Image Processing, 32:1927–1941, 2023. 1

    1927

  102. [110]

    Spatially-attentive patch-hierarchical network for adaptive motion deblurring

    Maitreya Suin, Kuldeep Purohit, and AN Rajagopalan. Spatially-attentive patch-hierarchical network for adaptive motion deblurring. InProceedings of the IEEE/CVF con- ference on computer vision and pattern recognition, pages 3606–3615, 2020. 1

    2020

  103. [111]

    Stripformer: Strip transformer for fast image deblurring

    Fu-Jen Tsai, Yan-Tsung Peng, Yen-Yu Lin, Chung-Chi Tsai, and Chia-Wen Lin. Stripformer: Strip transformer for fast image deblurring. InEuropean conference on computer vision, pages 146–162. Springer, 2022. 1, 6, 7, 3

    2022

  104. [112]

    Transweather: Transformer-based restoration of im- ages degraded by adverse weather conditions

    Jeya Maria Jose Valanarasu, Rajeev Yasarla, and Vishal M Patel. Transweather: Transformer-based restoration of im- ages degraded by adverse weather conditions. InProceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2353–2363, 2022. 6, 7

    2022

  105. [113]

    Neural discrete representation learning.Advances in neural information processing systems, 30, 2017

    Aaron Van Den Oord, Oriol Vinyals, et al. Neural discrete representation learning.Advances in neural information processing systems, 30, 2017. 4

    2017

  106. [114]

    Blind image quality evaluation using perception based features

    Narasimhan Venkatanath, D Praneeth, Maruthi Chan- drasekhar Bh, Sumohana S Channappayya, and Swarup S Medasani. Blind image quality evaluation using perception based features. In2015 twenty first national conference on communications (NCC), pages 1–6. IEEE, 2015. 4, 1

    2015

  107. [115]

    A connection between score matching and denoising autoencoders.Neural computation, 23(7):1661– 1674, 2011

    Pascal Vincent. A connection between score matching and denoising autoencoders.Neural computation, 23(7):1661– 1674, 2011. 4

    2011

  108. [116]

    Sketch-guided text-to-image diffusion models

    Andrey V oynov, Kfir Aberman, and Daniel Cohen-Or. Sketch-guided text-to-image diffusion models. InACM SIGGRAPH 2023 Conference Proceedings, pages 1–11,

    2023

  109. [117]

    Pretraining is all you need for image-to-image translation.arXiv preprint arXiv:2205.12952, 2022

    Tengfei Wang, Ting Zhang, Bo Zhang, Hao Ouyang, Dong Chen, Qifeng Chen, and Fang Wen. Pretraining is all you need for image-to-image translation.arXiv preprint arXiv:2205.12952, 2022. 3

    2022 arXiv

  110. [118]

    Images speak in images: A generalist painter for in-context visual learning

    Xinlong Wang, Wen Wang, Yue Cao, Chunhua Shen, and Tiejun Huang. Images speak in images: A generalist painter for in-context visual learning. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6830–6839, 2023. 3

    2023

  111. [119]

    Image quality assessment: from error visibility to structural similarity.IEEE transactions on image pro- cessing, 13(4):600–612, 2004

    Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. Image quality assessment: from error visibility to structural similarity.IEEE transactions on image pro- cessing, 13(4):600–612, 2004. 6, 4

    2004

  112. [120]

    Uformer: A gen- eral u-shaped transformer for image restoration

    Zhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou, Jianzhuang Liu, and Houqiang Li. Uformer: A gen- eral u-shaped transformer for image restoration. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 17683–17693, 2022. 6, 3

    2022

  113. [121]

    Blind2unblind: Self-supervised image denoising with visi- ble blind spots

    Zejin Wang, Jiazheng Liu, Guoqing Li, and Hua Han. Blind2unblind: Self-supervised image denoising with visi- ble blind spots. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2027– 2036, 2022. 1

    2027

  114. [122]

    De- blurring via stochastic refinement

    Jay Whang, Mauricio Delbracio, Hossein Talebi, Chitwan Saharia, Alexandros G Dimakis, and Peyman Milanfar. De- blurring via stochastic refinement. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16293–16303, 2022. 1

    2022

  115. [123]

    Con- trastive learning for compact single image dehazing

    Haiyan Wu, Yanyun Qu, Shaohui Lin, Jian Zhou, Ruizhi Qiao, Zhizhong Zhang, Yuan Xie, and Lizhuang Ma. Con- trastive learning for compact single image dehazing. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10551–10560, 2021. 6, 7

    2021

  116. [124]

    Q-bench: A benchmark for general-purpose foundation models on low-level vision

    Haoning Wu, Zicheng Zhang, Erli Zhang, Chaofeng Chen, Liang Liao, Annan Wang, Chunyi Li, Wenxiu Sun, Qiong Yan, Guangtao Zhai, et al. Q-bench: A benchmark for general-purpose foundation models on low-level vision. arXiv preprint arXiv:2309.14181, 2023. 1

    2023 arXiv

  117. [125]

    Diffir: Efficient diffusion model for image restoration

    Bin Xia, Yulun Zhang, Shiyin Wang, Yitong Wang, Xing- long Wu, Yapeng Tian, Wenming Yang, and Luc Van Gool. Diffir: Efficient diffusion model for image restoration. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13095–13105, 2023. 2, 6, 7, 3

    2023

  118. [126]

    Image de-raining transformer.IEEE Transac- tions on Pattern Analysis and Machine Intelligence, 45(11): 12978–12995, 2022

    Jie Xiao, Xueyang Fu, Aiping Liu, Feng Wu, and Zheng- Jun Zha. Image de-raining transformer.IEEE Transac- tions on Pattern Analysis and Machine Intelligence, 45(11): 12978–12995, 2022. 6, 3

    2022

  119. [127]

    Smartbrush: Text and shape guided object inpaint- ing with diffusion model

    Shaoan Xie, Zhifei Zhang, Zhe Lin, Tobias Hinz, and Kun Zhang. Smartbrush: Text and shape guided object inpaint- ing with diffusion model. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22428–22437, 2023. 3

    2023

  120. [128]

    Scale-free single image deraining via visibility- enhanced recurrent wavelet learning.IEEE Transactions on Image Processing, 28(6):2948–2961, 2019

    Wenhan Yang, Jiaying Liu, Shuai Yang, and Zongming Guo. Scale-free single image deraining via visibility- enhanced recurrent wavelet learning.IEEE Transactions on Image Processing, 28(6):2948–2961, 2019. 6

    2019

  121. [129]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models.arXiv preprint arXiv:2308.06721,

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models.arXiv preprint arXiv:2308.06721,

    arXiv

  122. [130]

    Learning diffusion texture pri- ors for image restoration

    Tian Ye, Sixiang Chen, Wenhao Chai, Zhaohu Xing, Jing Qin, Ge Lin, and Lei Zhu. Learning diffusion texture pri- ors for image restoration. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2524–2534, 2024. 2

    2024

  123. [131]

    Scaling up to excellence: Practicing model scaling for photo-realistic image restoration in the wild

    Fanghua Yu, Jinjin Gu, Zheyuan Li, Jinfan Hu, Xiang- tao Kong, Xintao Wang, Jingwen He, Yu Qiao, and Chao Dong. Scaling up to excellence: Practicing model scaling for photo-realistic image restoration in the wild. InPro- ceedings of the IEEE/CVF Conference on Computer Vision a...

    2024

  124. [132]

    Resshift: Efficient diffusion model for image super- resolution by residual shifting.Advances in Neural Infor- mation Processing Systems, 36, 2024

    Zongsheng Yue, Jianyi Wang, and Chen Change Loy. Resshift: Efficient diffusion model for image super- resolution by residual shifting.Advances in Neural Infor- mation Processing Systems, 36, 2024. 2, 5

    2024

  125. [133]

    Multi-stage progressive image restoration

    Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Ming-Hsuan Yang, and Ling Shao. Multi-stage progressive image restoration. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14821–14831, 2021. 6, 7, 3

    2021

  126. [134]

    Restormer: Efficient transformer for high-resolution image restoration

    Syed Waqas Zamir, Aditya Arora, Salman Khan, Mu- nawar Hayat, Fahad Shahbaz Khan, and Ming-Hsuan Yang. Restormer: Efficient transformer for high-resolution image restoration. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5728–5739,

  127. [135]

    Learning enriched features for fast image restoration and enhancement.IEEE transactions on pattern analysis and machine intelligence, 45(2):1934–1948, 2022

    Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Ming-Hsuan Yang, and Ling Shao. Learning enriched features for fast image restoration and enhancement.IEEE transactions on pattern analysis and machine intelligence, 45(2):1934–1948, 2022. 7

    1934

  128. [136]

    Accurate image restora- tion with attention retractable transformer.arXiv preprint arXiv:2210.01427, 2022

    Jiale Zhang, Yulun Zhang, Jinjin Gu, Yongbing Zhang, Linghe Kong, and Xin Yuan. Accurate image restora- tion with attention retractable transformer.arXiv preprint arXiv:2210.01427, 2022. 6, 7, 3

    2022 arXiv

  129. [137]

    Ingredient-oriented multi- degradation learning for image restoration

    Jinghao Zhang, Jie Huang, Mingde Yao, Zizheng Yang, Hu Yu, Man Zhou, and Feng Zhao. Ingredient-oriented multi- degradation learning for image restoration. InProceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 5825–5835, 2023. 5

    2023

  130. [138]

    Deep dense multi-scale network for snow removal using semantic and depth priors.IEEE Trans- actions on Image Processing, 30:7419–7431, 2021

    Kaihao Zhang, Rongqing Li, Yanjiang Yu, Wenhan Luo, and Changsheng Li. Deep dense multi-scale network for snow removal using semantic and depth priors.IEEE Trans- actions on Image Processing, 30:7419–7431, 2021. 6, 3

    2021

  131. [139]

    Plug-and-play image restora- tion with deep denoiser prior.IEEE Transactions on Pat- tern Analysis and Machine Intelligence, 44(10):6360–6376,

    Kai Zhang, Yawei Li, Wangmeng Zuo, Lei Zhang, Luc Van Gool, and Radu Timofte. Plug-and-play image restora- tion with deep denoiser prior.IEEE Transactions on Pat- tern Analysis and Machine Intelligence, 44(10):6360–6376,

  132. [140]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3836–3847, 2023. 3, 5

    2023

  133. [141]

    Efros, Eli Shecht- man, and Oliver Wang

    Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric.2018 IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 586–595, 2018. 4

    2018

  134. [142]

    The unreasonable effectiveness of deep features as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. InProceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 586–595, 2018. 4, 6

    2018

  135. [143]

    Perceive-ir: Learning to perceive degradation better for all-in-one image restoration.arXiv preprint arXiv:2408.15994, 2024

    Xu Zhang, Jiaqi Ma, Guoli Wang, Qian Zhang, Huan Zhang, and Lefei Zhang. Perceive-ir: Learning to perceive degradation better for all-in-one image restoration.arXiv preprint arXiv:2408.15994, 2024. 1, 2

    2024 arXiv

  136. [144]

    Diffusion-based blind text image super-resolution

    Yuzhe Zhang, Jiawei Zhang, Hao Li, Zhouxia Wang, Luwei Hou, Dongqing Zou, and Liheng Bian. Diffusion-based blind text image super-resolution. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 25827–25836, 2024. 2

    2024

  137. [145]

    Real-time controllable denoising for image and video

    Zhaoyang Zhang, Yitong Jiang, Wenqi Shao, Xiaogang Wang, Ping Luo, Kaimo Lin, and Jinwei Gu. Real-time controllable denoising for image and video. InProceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14028–14038, 2023. 2

    2023

  138. [146]

    Wavelet-based fourier information interaction with fre- quency diffusion adjustment for underwater image restora- tion

    Chen Zhao, Weiling Cai, Chenyu Dong, and Chengwei Hu. Wavelet-based fourier information interaction with fre- quency diffusion adjustment for underwater image restora- tion. InProceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, pages 8281–8291,

  139. [147]

    Selective hourglass mapping for universal image restoration based on diffusion model

    Dian Zheng, Xiao-Ming Wu, Shuzhou Yang, Jian Zhang, Jian-Fang Hu, and Wei-Shi Zheng. Selective hourglass mapping for universal image restoration based on diffusion model. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 25445– 25455, 2024. 2

    2024

  140. [148]

    Empowering low- light image enhancer through customized learnable priors

    Naishan Zheng, Man Zhou, Yanmeng Dong, Xiangyu Rui, Jie Huang, Chongyi Li, and Feng Zhao. Empowering low- light image enhancer through customized learnable priors. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 12559–12569, 2023. 2

    2023

  141. [149]

    Learning weather-general and weather-specific features for image restoration under multiple adverse weather conditions

    Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, and Xiaowei Hu. Learning weather-general and weather-specific features for image restoration under multiple adverse weather conditions. In Proceedings of the IEEE/CVF conference on computer vi- sion...

    2023

  142. [150]

    dangling,

    Additional Details of visual instruction Visual Ground Blank Ground Simple Ground Figure 5. Replacement of visual ground. We focus on introducing visual instructions as they are promising in aligning with visual degradations. However, image degradations are “dangling,” meaning...

  143. [151]

    4 consists of All-in-One datasets, mixed distortion datasets, and natural mixture datasets

    More Details About Datasets Our dataset in Sec. 4 consists of All-in-One datasets, mixed distortion datasets, and natural mixture datasets. All-in-One datasets contain images from a variety of dif- ferent image recovery tasks. Our method and some of the comparison methods are ...

    1961

  144. [152]

    The input size is224×224, randomly cropped during training and center-cropped dur- ing inference

    Implementation Details For the visual instruct tokenizer, we follow the implementa- tion of [27] 1 and adapt its ImageNet-pretrained [100] VQ- GAN model to our framework. The input size is224×224, randomly cropped during training and center-cropped dur- ing inference. The embe...

  145. [153]

    The batch size is 8

    with a learning rate of 4.5e-6, andβ 1 = 0.5,β 2 = 0.9. The batch size is 8. We adopt random horizontal flip as data augmentation. The base Diffusion model uses U-Net [22] as the back- bone for its restoration process, with weights pre-trained on the LAION-5B dataset [102]. Bu...

  146. [154]

    Addition Experimental Results 9.1. Comparison with SOTAs on Percetual Metrics We also compare our method with previous SOTAs on per- ceptual metrics, namely FID [35] and LPIPS [141], which are usually more aligned with human visual preference than reference-based metrics such ...

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.