REVIEW 3 major objections 5 minor 2 cited by
UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity
T0 review · 3 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read UniRestorer claims an all-in-one restorer can get degradation-specific precision and robustness to estimation error at once by routing at a granularity matched to estimation confidence.
desk verdict UniRestorer is a serious empirical advance in all-in-one restoration, but the multi-granularity cluster semantics need direct validation before the mechanism is fully credited. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the multi-granularity degradation set: a hierarchy of non-overlapping clusters obtained by K-means on degradation embeddings extracted by a DA-CLIP-trained encoder, with the number of groups growing from 1 to 7 to 19 in the single-degradation setup, and from 1 to 4 to 8 in the mixed-degradation setup. Each group trains its own full-network expert, so the same corrupted image can be restored by a specialist or by a generalist depending on routing. The router that carries the argument is the pair of estimators $H_d$ and $H_g$ trained with the data-uncertainty loss $L_{\mathrm{dg}} = \frac{1}{2 e_{\mathrm{gran}}}(u_{y_i} - e_{\mathrm{deg}})^2 + \frac{1}{2}\ln e_{\mathrm{gran}}$, where $e_{\mathrm{gran}}$ plays the role of a learned error estimate for $e_{\mathrm{deg}}$; a second router then picks the coarsest expert whose breadth matches that uncertainty. A load-balance loss prevents the routing from collapsing onto the finest-grained experts. The mechanism turns a single point estimate of degradation into a confidence-aware routing decision.
What would settle it
Train the same multi-granularity MoE pipeline after replacing the learned degradation embeddings with random features or with features from an encoder never exposed to degradations; if the gains persist, the claimed benefit does not come from degradation structure. A complementary test is to evaluate routing accuracy on degradation parameters drawn from outside the hand-set strength bins used to train the extractor — the paper reports 92% routing accuracy in-distribution and 82% out-of-distribution, so a large drop under shifted parameters would show the granularity estimator only interpolates the training bins.
Extended reading notes
Core claim
The central claim is that degradation estimation error need not be a fatal flaw of degradation-aware restoration: it can be modeled and exploited. UniRestorer first trains a fine-grained degradation-representation extractor based on DA-CLIP, then runs hierarchical K-means on the extracted embeddings to build a three-level degradation set — 1, 7, and 19 groups in the single-degradation setup, 1, 4, and 8 in mixed-degradation — and trains a full restoration network for every group. Two routers then decide the expert: one estimates the finest-level degradation group, and the other estimates a granularity that, through a data-uncertainty loss, encodes how wrong the first estimate is likely to be. In the authors' experiments the automatic mode reaches 41.68 dB PSNR on Rain100L deraining and 36.44 dB on SOTS dehazing versus 38.57 and 31.34 dB for the strongest compared all-in-one method, and the instruction mode matches or beats dedicated single-task models on most tasks. The paper itself notes that its training data come from public datasets and its degradation space is synthetic; it lists larger-scale data and real-world degradation alignment as future work.
Load-bearing premise
The entire pipeline rests on the premise that the degradation extractor's feature clusters correspond to degradation types and severities that are genuinely useful for restoration; if the clusters are arbitrary, the finer experts receive inconsistent training data and the routers can only learn an arbitrary mapping.
Editorial extensions
If this is right
- On the seven single-degradation tasks, automatic routing lifts the five-task average PSNR to 33.38 dB from 30.58 dB for the best compared all-in-one method, and the seven-task average to 31.34 dB; expert specialization, not a bigger shared backbone, drives the gain.
- Instruction mode, where the user supplies the degradation type as a pruning mask, puts UniRestorer at parity with or above single-task models on most tasks, showing the all-in-one versus single-task performance gap is largely a routing problem rather than a capacity problem.
- Mixed-degradation results improve from 22.06 to 24.46 dB in-distribution and from 17.23 to 19.45 dB out-of-distribution over the shared backbone, and the multi-granularity ablation shows coarse levels are what buy out-of-distribution robustness.
- The system generalizes to real-world and unseen datasets (LHP, LOLv2, RealSnow, raindrop, under-display camera, underwater) without retraining, consistent with the claim that coarse experts provide a fallback when the degradation is outside the training distribution.
Reading between the lines
- Beyond the paper, the confidence-conditioned routing recipe is transferable: any model that conditions on a noisy predictor could use a similar uncertainty estimate to fall back to a broader hypothesis class, such as blind super-resolution or restoration agents managing a zoo of specialist models.
- Because the authors freeze experts before training routers and show gains over scaled-up monolithic models, an economical extension would replace full experts with LoRA or adapter specialists and test whether granularity routing still delivers most of the gain at a fraction of the training cost.
- A natural next step the paper leaves implicit is an online variant that updates cluster centers as new degradation types arrive, turning the fixed multi-granularity partition into a growing taxonomy of corruptions.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes UniRestorer, an all-in-one image restoration framework built around a multi-granularity mixture-of-experts design. A DA-CLIP-based degradation extractor is trained on fine-grained synthetic degradations; its features are hierarchically K-means clustered into three granularity levels (e.g., 1/7/19 clusters for single-degradation and 1/4/8 for mixed-degradation). Separate full-network experts are trained on each cluster's data, and routing is performed by two learned heads: a degradation head that selects a finest-level cluster and a granularity head that chooses an appropriate granularity level, intended to be robust to degradation estimation errors. Experiments cover seven single-degradation tasks and seven mixed-degradation scenarios, plus real-world and unseen-degradation generalization. The reported results substantially outperform prior all-in-one methods in auto mode and approach or exceed single-task models in an instruction mode where the task name is provided.
Significance. If the main empirical claims hold, UniRestorer is a significant advance for all-in-one restoration: the auto-mode gains in Table 1 (e.g., Rain100L 41.68 dB vs. 38.57 dB and SOTS 36.44 dB vs. 31.34 dB for the best prior methods) and in Table 2 are large, and the real-world and unseen-degradation results in Tables 4-5 are encouraging. The paper also includes useful ablations (Tables 6-8), a router-component study (Table E), scaled-up baseline comparisons (Table B), and lightweight expert variants (Table A), which help separate the contribution of the proposed mechanism from raw capacity. The authors commit to releasing code and models. The central weakness is that the semantic validity of the learned degradation clusters—the load-bearing premise of the whole mechanism—is not quantitatively established, and the comparison to single-task models in instruction mode is not fully fair as presented.
major comments (3)
- [Sec. 3.2, Eq. (4), and Sec. B] The load-bearing premise that K-means clusters in the DA-CLIP DR space are semantically coherent—corresponding to degradation types and severities—is never quantitatively established. The paper provides only qualitative t-SNE (Fig. B) and a deraining-only DR-extractor ablation (Table 6); neither measures agreement between cluster assignments and the known synthetic degradation labels (type and degree ranges in Sec. A/B). Because the degradation and granularity heads Hd/Hg and the routers Gd/Gg are trained against these same cluster centers in Eqs. (6)-(7), the routing results cannot independently validate the partition. I request cluster purity or adjusted mutual information against the known degradation parameters, plus a control in which experts are trained on random partitions of the same cardinality. Without this, the reported gains could come from the large set of full-size experts and sparse routing rather than from degradation-aware specialization.
- [Sec. 3.3, Eq. (7), and Table C] The robustness claim—that granularity estimation routes to coarser experts when degradation estimation is unreliable—is not directly tested. egran is trained from the distance between edeg and the finest-level center, but no experiment verifies that egran tracks actual degradation estimation error or that coarser routing is selected in high-error cases. Table C reports expert usage statistics and routing accuracy (92%/82%), but not error-conditional behavior. Please add a controlled analysis, e.g., degrade inputs with known parameters, measure edeg error against ground truth, and show that Gg selects coarser experts as error increases; or perturb edeg and show that UniRestorer degrades less than a finest-only router. This is needed to support the abstract's central claim of robustness to degradation estimation error.
- [Sec. 4.2, Table 3, and Sec. A.1] The instruction-mode comparison with single-task models is not on equal footing. For deraining, the authors retrain experts on Rain200H/Rain200L/DID/DDN, which is a larger and more diverse set than the Rain100L used in the all-in-one comparison, while the single-task baselines are trained on their own standard data. Also, Ours† receives the task name as a pruning signal during inference. To support the 'closing the gap' claim, either train the single-task baselines on the same enlarged deraining data, or report Ours† without the extra deraining data, and state clearly in the main text what training data each entry uses.
minor comments (5)
- [Sec. 3.1, Eq. (2)] Equation (2) appears to add Gaussian noise after the Softmax; the standard noisy top-k gating from Shazeer et al. applies the noise to the logits before the Softmax. Please correct or clarify, since the current equation does not implement the cited mechanism.
- [Tables 7-8] The abbreviation 'MiO' is not defined in the main text, and the ablation tables report small differences (e.g., 24.46 vs. 24.41 in-dist for 3 vs. 4 granularity levels) without error bars or multiple seeds, so the claimed plateau and optimal-configuration conclusions are not statistically supported.
- [References and citations] The reference list contains placeholder entries ([5]-[8], [35], [36]) and missing citations such as 'DesnowNet [? ]' in Sec. 1 and Sec. 2. Please clean up the bibliography and all in-text citations before publication.
- [Table 2] The PromptIR row is cited as [82], which is TransWeather; the PromptIR reference is [67]. Please check the citation and also define 'CAR' and 'MiO' at first use.
- [Sec. 3.3, Eq. (6)] The notation in Eq. (6) is under-specified: the candidate set {F0,0,...,Fn−1,k} and the TopK operation need precise definitions, and the sentence 'Gd is conducted in the finest-grained level' is inconsistent with Gg selecting the granularity. Please clarify the two-stage routing procedure.
Circularity Check
No significant circularity: the central restoration claims are held-out empirical evaluations, not derivations from fitted values; only a minor, non-load-bearing self-citation to co-authored RestoreAgent appears.
full rationale
UniRestorer's central claim is not a mathematical derivation from first principles but an empirical system evaluated on held-out restoration benchmarks. The multi-granularity degradation set is built by unsupervised K-means on the DR extractor's feature space (Eq. 4), and the routers are trained with a data-uncertainty loss (Eq. 7) whose target is the K-means center from that same feature space. This creates a self-referential label-generation process: both the expert grouping and the routing target come from the same degradation extractor D. However, the paper's actual claims concern end-to-end restoration PSNR/SSIM on held-out test sets (Tables 1-5), not the recovery of the cluster labels themselves, and routing is evaluated on images not used to fit the routers. Therefore the central result does not reduce to a fitted value by construction. The only self-citation to co-authored prior work is RestoreAgent [14] for the design choice of using full restoration networks as experts (Sec. 3.2); that choice is not load-bearing for the core derivation and is compared against external baselines. The absence of a cluster-purity or random-cluster control is a validity concern about whether the gains come from degradation semantics rather than added capacity, but it is not a circularity of the derivation. Overall score 2 reflects one minor non-load-bearing self-citation and the self-referential clustering design, with no circular derivation. Honest non-finding is appropriate: the paper is empirically self-contained against held-out benchmarks.
Assumptions & free parameters
free parameters (3)
- Number of clusters per granularity =
Single-degradation: {1, 7, 19}; mixed-degradation: {1, 4, 8}
- Routing loss weights alpha and beta =
alpha=0.1, beta=0.01
- Degree thresholds for DR extractor training labels =
e.g., rain strength 0-50/50-100/100-150; noise sigma 0-15/15-35/35-50; haze beta >0.1 thick
assumptions (3)
- domain assumption DA-CLIP image encoder features, after contrastive training on synthetic degradations, provide a degradation representation that separates degradation types and degrees.
- domain assumption K-means clustering of the DR features yields groups that correspond to useful training subsets for restoration experts.
- domain assumption An uncertainty scalar egran can be learned from Eq. (7) and used to choose between fine and coarse experts.
Cite this review
Pith. "Pith review of UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity." pith.science (2026). https://pith.science/paper/GIRIZ66J
@misc{pith2026241220157,
author = {Pith},
title = {Pith review of: UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity},
year = {2026},
howpublished = {\url{https://pith.science/paper/GIRIZ66J}},
note = {Machine review of arXiv:2412.20157}
}
read the original abstract
Recently, considerable progress has been made in all-in-one image restoration. Generally, existing methods can be degradation-agnostic or degradation-aware. However, the former are limited in leveraging degradation-specific restoration, and the latter suffer from the inevitable error in degradation estimation. Consequently, the performance of existing methods has a large gap compared to specific single-task models. In this work, we make a step forward in this topic, and present our UniRestorer with improved restoration performance. Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model. Then, UniRestorer adopts both degradation and granularity estimation to adaptively select an appropriate expert for image restoration. In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration, and use granularity estimation to make the model robust to degradation estimation error. Experimental results show that our UniRestorer outperforms state-of-the-art all-in-one methods by a large margin, and is promising in closing the performance gap to specific single task models.
Figures
Figures from the paper (1 more)
Forward citations
Cited by 2 Pith papers
-
M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restoration
M2Restore is a CLIP-guided Mixture-of-Experts Mamba-CNN model that reports state-of-the-art results on the All-weather all-in-one image restoration benchmark.
-
ClusIR: Towards Cluster-Guided All-in-One Image Restoration
A cluster-guided mixture-of-experts network with frequency modulation reports competitive all-in-one image restoration results, with uneven gains and no public code.
Reference graph
Works this paper leans on
-
[1]
Abdelrahman Abdelhamed, Stephen Lin, and Michael S. Brown. A high-quality denoising dataset for smartphone cameras. In CVPR, 2018
2018
-
[2]
Ntire 2017 challenge on single image super-resolution: Dataset and study
Eirikur Agustsson and Radu Timofte. Ntire 2017 challenge on single image super-resolution: Dataset and study. In CVPRW, July 2017
2017
-
[3]
Lora-ir: Taming low-rank experts for efficient all-in-one image restoration
Yuang Ai, Huaibo Huang, and Ran He. Lora-ir: Taming low-rank experts for efficient all-in-one image restoration. arXiv preprint arXiv:2410.15385, 2024
arXiv 2024
-
[4]
Multimodal prompt perceiver: Empower adaptiveness, generalizability and fidelity for all-in-one image restoration
Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, and Ran He. Multimodal prompt perceiver: Empower adaptiveness, generalizability and fidelity for all-in-one image restoration. In CVPR, 2024
2024
-
[5]
Frobnication
FirstName Alpher. Frobnication. IEEE TPAMI, 12(1):234–778, 2002
2002
-
[6]
Frobnication revisited
FirstName Alpher and FirstName Fotheringham-Smythe. Frobnication revisited. Journal of F oo, 13(1): 234–778, 2003
2003
-
[7]
Can a computer frobnicate? In CVPR, pages 234–778, 2005
FirstName Alpher and FirstName Gamow. Can a computer frobnicate? In CVPR, pages 234–778, 2005
2005
-
[8]
Can a machine frobnicate? Journal of F oo, 14(1):234–778, 2004
FirstName Alpher, FirstName Fotheringham-Smythe, and FirstName Gamow. Can a machine frobnicate? Journal of F oo, 14(1):234–778, 2004
2004
Show all 115 references
-
[9]
The power of scale for parameter-efficient prompt tuning
Lester Brian, Al-Rfou Rami, and Constant Noah. The power of scale for parameter-efficient prompt tuning. In EMNLP, November 2021
2021
-
[10]
Retinexformer: One-stage retinex-based transformer for low-light image enhancement
Yuanhao Cai, Hao Bian, Jing Lin, Haoqian Wang, Radu Timofte, and Yulun Zhang. Retinexformer: One-stage retinex-based transformer for low-light image enhancement. In ICCV, 2023
2023
-
[11]
Hair: Hypernetworks-based all-in-one image restoration
Jin Cao, Yi Cao, Li Pang, Deyu Meng, and Xiaoyong Cao. Hair: Hypernetworks-based all-in-one image restoration. arXiv preprint arXiv:2408.08091, 2024
2024 arXiv
-
[12]
Grids: Grouped multiple-degradation restoration with image degradation similarity
Shuo Cao, Yihao Liu, Wenlong Zhang, Yu Qiao, and Chao Dong. Grids: Grouped multiple-degradation restoration with image degradation similarity. In ECCV, 2024
2024
-
[13]
Data uncertainty learning in face recognition
Jie Chang, Zhonghao Lan, Changmao Cheng, and Yichen Wei. Data uncertainty learning in face recognition. In CVPR, 2020
2020
-
[14]
Restoreagent: Autonomous image restoration agent via multimodal large language models
Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Sixiang Chen, Tian Ye, Renjing Pei, Kaiwen Zhou, Fenglong Song, and Lei Zhu. Restoreagent: Autonomous image restoration agent via multimodal large language models. In NeurIPS, 2024
2024
-
[15]
Simple baselines for image restoration
Liangyu Chen, Xiaojie Chu, Xiangyu Zhang, and Jian Sun. Simple baselines for image restoration. In ECCV, 2022
2022
-
[16]
An efficient general-purpose modular vision model via multi-task heterogeneous training
Zitian Chen, Mingyu Ding, Yikang Shen, Wei Zhan, Masayoshi Tomizuka, Erik Learned-Miller, and Chuang Gan. An efficient general-purpose modular vision model via multi-task heterogeneous training. arXiv preprint arXiv:2306.17165, 2023
2023 arXiv
-
[17]
Mod-squad: Designing mixtures of experts as modular multi-task learners
Zitian Chen, Yikang Shen, Mingyu Ding, Zhenfang Chen, Hengshuang Zhao, Erik Learned-Miller, and Chuang Gan. Mod-squad: Designing mixtures of experts as modular multi-task learners. CVPR, 2023
2023
-
[18]
Unified scaling laws for routed language models
Aidan Clark, Diego de las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew Johnson, Katie Millican, Albin Cassirer, Chris Jones,...
2022
-
[19]
Conde, Gregor Geigle, and Radu Timofte
Marcos V . Conde, Gregor Geigle, and Radu Timofte. Instructir: High-quality image restoration following human instructions. In ECCV, 2024
2024
-
[20]
Learning a deep convolutional network for image super-resolution
Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. Learning a deep convolutional network for image super-resolution. In ECCV, 2014
2014
-
[21]
A general decoupled learning framework for parameterized image operators
Qingnan Fan, Dongdong Chen, Lu Yuan, Gang Hua, Nenghai Yu, and Baoquan Chen. A general decoupled learning framework for parameterized image operators. IEEE TPAMI, 2019
2019
-
[22]
Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity
William Fedus, Barret Zoph, and Noam Shazeer. Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. Journal of Machine Learning Research, 2022. 31
2022
-
[23]
Removing rain from single images via a deep detail network
Xueyang Fu, Jiabin Huang, Delu Zeng, Yue Huang, Xinghao Ding, and John Paisley. Removing rain from single images via a deep detail network. In CVPR, 2017
2017
-
[24]
Onerestore: A universal restoration framework for composite degradation
Yu Guo, Yuan Gao, Yuxu Lu, Ryan Wen Liu, and Shengfeng He. Onerestore: A universal restoration framework for composite degradation. In ECCV, 2024
2024
-
[25]
From sky to the ground: A large-scale benchmark and simple baseline towards real rain removal
Yun Guo, Xueyao Xiao, Yi Chang, Shumin Deng, and Luxin Yan. From sky to the ground: A large-scale benchmark and simple baseline towards real rain removal. In ICCV, 2023
2023
-
[26]
Modulating image restoration with continual levels via adaptive feature modification layers
Jingwen He, Chao Dong, and Yu Qiao. Modulating image restoration with continual levels via adaptive feature modification layers. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019
2019
-
[27]
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In CVPR, 2016
2016
-
[28]
Parameter-efficient transfer learning for nlp
Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin de Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. Parameter-efficient transfer learning for nlp. In ICML, 2019
2019
-
[29]
LoRA: Low-rank adaptation of large language models
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. LoRA: Low-rank adaptation of large language models. In ICLR, 2022
2022
-
[30]
Jacobs, Michael I
Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan, and Geoffrey E. Hinton. Adaptive mixtures of local experts. Neural Computation, 1991
1991
-
[31]
Universal image restoration pre-training via degradation classification
Hu JiaKui, Zhengjian Yao, Jin Lujia, and Lu Yanye. Universal image restoration pre-training via degradation classification. In ICLR, 2025
2025
-
[32]
A survey on all-in-one image restoration: Taxonomy, evaluation and future trends
Junjun Jiang, Zengyuan Zuo, Gang Wu, Kui Jiang, and Xianming Liu. A survey on all-in-one image restoration: Taxonomy, evaluation and future trends. arXiv preprint arXiv:2410.15067, 2024
2024 arXiv
-
[33]
Jordan and R.A
M.I. Jordan and R.A. Jacobs. Hierarchical mixtures of experts and the em algorithm. In Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan) , 1993
1993
-
[34]
Deblurgan-v2: Deblurring (orders-of- magnitude) faster and better
Orest Kupyn, Tetiana Martyniuk, Junru Wu, and Zhangyang Wang. Deblurgan-v2: Deblurring (orders-of- magnitude) faster and better. In ICCV, Oct 2019
2019
-
[35]
The frobnicatable foo filter, 2014
FirstName LastName. The frobnicatable foo filter, 2014. Face and Gesture submission ID 324. Supplied as supplemental material fg324.pdf
2014
-
[36]
Frobnication tutorial, 2014
FirstName LastName. Frobnication tutorial, 2014. Supplied as supplemental material tr.pdf
2014
-
[37]
{GS}hard: Scaling giant models with conditional computation and automatic sharding
Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. {GS}hard: Scaling giant models with conditional computation and automatic sharding. In ICLR, 2021
2021
-
[38]
Base layers: Simplify- ing training of large, sparse models
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, and Luke Zettlemoyer. Base layers: Simplify- ing training of large, sparse models. In NeurIPS, 2021
2021
-
[39]
Benchmarking single-image dehazing and beyond
Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. Benchmarking single-image dehazing and beyond. IEEE TIP, 28(1):492–505, 2019
2019
-
[40]
All-In-One Image Restoration for Unknown Corruption
Boyun Li, Xiao Liu, Peng Hu, Zhongqin Wu, Jiancheng Lv, and Xi Peng. All-In-One Image Restoration for Unknown Corruption. In CVPR, 2022
2022
-
[41]
An underwater image enhancement benchmark dataset and beyond
Chongyi Li, Chunle Guo, Wenqi Ren, Runmin Cong, Junhui Hou, Sam Kwong, and Dacheng Tao. An underwater image enhancement benchmark dataset and beyond. IEEE TIP, 29:4376–4389, 2020
2020
-
[42]
Foundir: Unleashing million-scale training data to advance foundation models for image restoration
Hao Li, Xiang Chen, Jiangxin Dong, Jinhui Tang, and Jinshan Pan. Foundir: Unleashing million-scale training data to advance foundation models for image restoration. arXiv preprint arXiv:2412.01427, 2024
2024 arXiv
-
[43]
Junnan Li, Dongxu Li, Caiming Xiong, and Steven C. H. Hoi. BLIP: bootstrapping language-image pre-training for unified vision-language understanding and generation. In ICML, 2022
2022
-
[44]
Junnan Li, Dongxu Li, Silvio Savarese, and Steven C. H. Hoi. BLIP-2: bootstrapping language-image pre-training with frozen image encoders and large language models. In ICML, 2023
2023
-
[45]
Spatially adaptive self-supervised learning for real-world image denoising
Junyi Li, Zhilu Zhang, Xiaoyu Liu, Chaoyu Feng, Xiaotao Wang, Lei Lei, and Wangmeng Zuo. Spatially adaptive self-supervised learning for real-world image denoising. In CVPR, 2023. 32
2023
-
[46]
Tbsn: Transformer-based blind-spot network for self- supervised image denoising
Junyi Li, Zhilu Zhang, and Wangmeng Zuo. Tbsn: Transformer-based blind-spot network for self- supervised image denoising. arXiv preprint arXiv:2404.07846, 2024
2024 arXiv
-
[47]
D2c-sr: A divergence to convergence approach for real-world image super-resolution
Youwei Li, Haibin Huang, Lanpeng Jia, Haoqiang Fan, and Shuaicheng Liu. D2c-sr: A divergence to convergence approach for real-world image super-resolution. In ECCV, 2022
2022
-
[48]
Efficient and degradation-adaptive network for real-world image super-resolution
Jie Liang, Hui Zeng, and Lei Zhang. Efficient and degradation-adaptive network for real-world image super-resolution. In ECCV, 2022
2022
-
[49]
Swinir: Image restoration using swin transformer
Jingyun Liang, Jiezhang Cao, Guolei Sun, Kai Zhang, Luc Van Gool, and Radu Timofte. Swinir: Image restoration using swin transformer. In ICCVW, 2021
2021
-
[50]
Enhanced deep residual networks for single image super-resolution
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. Enhanced deep residual networks for single image super-resolution. In CVPRW, July 2017
2017
-
[51]
Improving image restoration through removing degradations in textual representations
Jingbo Lin, Zhilu Zhang, Yuxiang Wei, Dongwei Ren, Dongsheng Jiang, Qi Tian, and Wangmeng Zuo. Improving image restoration through removing degradations in textual representations. In CVPR, 2024
2024
-
[52]
Tape: Task-agnostic prior embedding for image restoration
Lin Liu, Lingxi Xie, Xiaopeng Zhang, Shanxin Yuan, Xiangyu Chen, Wengang Zhou, Houqiang Li, and Qi Tian. Tape: Task-agnostic prior embedding for image restoration. In ECCV, 2022
2022
-
[53]
Learning real-world image de-weathering with imperfect supervision
Xiaohui Liu, Zhilu Zhang, Xiaohe Wu, Chaoyu Feng, Xiaotao Wang, Lei Lei, and Wangmeng Zuo. Learning real-world image de-weathering with imperfect supervision. In AAAI, 2024
2024
-
[54]
semantics
Yihao Liu, Anran Liu, Jinjin Gu, Zhipeng Zhang, Wenhao Wu, Yu Qiao, and Chao Dong. Discovering distinctive "semantics" in super-resolution networks. arXiv preprint arXiv:2108.00406, 2022
2022 arXiv
-
[55]
Degae: A new pretraining paradigm for low-level vision
Yihao Liu, Jingwen He, Jinjin Gu, Xiangtao Kong, Yu Qiao, and Chao Dong. Degae: A new pretraining paradigm for low-level vision. In CVPR, June 2023
2023
-
[57]
Desnownet: Context-aware deep network for snow removal
Yun-Fu Liu, Da-Wei Jaw, Shih-Chia Huang, and Jenq-Neng Hwang. Desnownet: Context-aware deep network for snow removal. IEEE TIP, 27(6):3064–3073, 2018
2018
-
[58]
Swin transformer: Hierarchical vision transformer using shifted windows
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. In ICCV, 2021
2021
-
[59]
Controlling vision-language models for universal image restoration
Ziwei Luo, Fredrik K Gustafsson, Zheng Zhao, Jens Sjölund, and Thomas B Schön. Controlling vision-language models for universal image restoration. In ICLR, 2024
2024
-
[60]
Waterloo exploration database: New challenges for image quality assessment models
Kede Ma, Zhengfang Duanmu, Qingbo Wu, Zhou Wang, Hongwei Yong, Hongliang Li, and Lei Zhang. Waterloo exploration database: New challenges for image quality assessment models. IEEE Transactions on Image Processing, 2017
2017
-
[61]
Martin, Charless C
David R. Martin, Charless C. Fowlkes, Doron Tal, and Jitendra Malik. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In ICCV, 2001
2001
-
[62]
Machine learning, volume 1
Tom M Mitchell. Machine learning, volume 1. 1997
1997
-
[63]
Multimodal contrastive learning with LIMoe: the language-image mixture of experts
Basil Mustafa, Carlos Riquelme Ruiz, Joan Puigcerver, Rodolphe Jenatton, and Neil Houlsby. Multimodal contrastive learning with LIMoe: the language-image mixture of experts. In NeurIPS, 2022
2022
-
[65]
Deep multi-scale convolutional neural network for dynamic scene deblurring
Seungjun Nah, Tae Hyun Kim, and Kyoung Mu Lee. Deep multi-scale convolutional neural network for dynamic scene deblurring. In CVPR, July 2017
2017
-
[66]
All-in-one image restoration for unknown degradations using adaptive discriminative filters for specific degradations
Dongwon Park, Byung Hyun Lee, and Se Young Chun. All-in-one image restoration for unknown degradations using adaptive discriminative filters for specific degradations. In CVPR, 2023
2023
-
[67]
Promptir: Prompting for all-in-one image restoration
Vaishnav Potlapalli, Syed Waqas Zamir, Salman Khan, and Fahad Khan. Promptir: Prompting for all-in-one image restoration. In NeurIPS, 2023
2023
-
[68]
From sparse to soft mixtures of experts
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, and Neil Houlsby. From sparse to soft mixtures of experts. In ICLR, 2024. 33
2024
-
[69]
Tan, Wenhan Yang, Jiajun Su, and Jiaying Liu
Rui Qian, Robby T. Tan, Wenhan Yang, Jiajun Su, and Jiaying Liu. Attentive generative adversarial network for raindrop removal from a single image. In CVPR, June 2018
2018
-
[70]
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervision. In ICML, 2021
2021
-
[71]
Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale
Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, and Yuxiong He. Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale. In ICML, 2022
2022
-
[72]
Progressive image deraining networks: A better and simpler baseline
Dongwei Ren, Wangmeng Zuo, Qinghua Hu, Pengfei Zhu, and Deyu Meng. Progressive image deraining networks: A better and simpler baseline. In CVPR, 2019
2019
-
[73]
Real-world blur dataset for learning and benchmarking deblurring algorithms
Jaesung Rim, Haeyun Lee, Jucheol Won, and Sunghyun Cho. Real-world blur dataset for learning and benchmarking deblurring algorithms. In ECCV, 2020
2020
-
[74]
Scaling vision with sparse mixture of experts
Carlos Riquelme Ruiz, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Su- sano Pinto, Daniel Keysers, and Neil Houlsby. Scaling vision with sparse mixture of experts. In Advances in Neural Information Processing Systems , 2021
2021
-
[75]
Outrageously large neural networks: The sparsely-gated mixture-of-experts layer
Noam Shazeer, *Azalia Mirhoseini, *Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. In ICLR, 2017
2017
-
[76]
Sheikh, Z.Wang, L
H.R. Sheikh, Z.Wang, L. Cormack, and A.C. Bovik. Live image quality assessment database release 2. http://live.ece.utexas.edu/research/quality
-
[77]
Scaling vision- language models with sparse mixture of experts
Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, and Yuxiong He. Scaling vision- language models with sparse mixture of experts. In EMNLP, 2023
2023
-
[78]
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. In ICLR, 2015
2015
-
[79]
Vision transformers for single image dehazing
Yuda Song, Zhuqing He, Hui Qian, and Xin Du. Vision transformers for single image dehazing. IEEE TIP, 32:1927–1941, 2023
1927
-
[80]
Moiré photo restoration using multiresolution convolutional neural networks
Yujing Sun, Yizhou Yu, and Wenping Wang. Moiré photo restoration using multiresolution convolutional neural networks. IEEE TIP, 27(8):4160–4172, 2018
2018
-
[81]
Instruct-ipt: All-in-one image processing transformer via weight modulation
Yuchuan Tian, Jianhong Han, Hanting Chen, Yuanyuan Xi, Guoyang Zhang, Jie Hu, Chao Xu, and Yunhe Wang. Instruct-ipt: All-in-one image processing transformer via weight modulation. arXiv preprint arXiv:2407.00676, 2024
2024 arXiv
-
[82]
Jeya Maria Jose Valanarasu, Rajeev Yasarla, and Vishal M. Patel. Transweather: Transformer-based restoration of images degraded by adverse weather conditions. In CVPR, 2022
2022
-
[83]
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NeurIPS, 2017
2017
-
[84]
Additive margin softmax for face verification
Feng Wang, Jian Cheng, Weiyang Liu, and Haijun Liu. Additive margin softmax for face verification. IEEE Signal Processing Letters, 2018
2018
-
[85]
Real-esrgan: Training real-world blind super-resolution with pure synthetic data
Xintao Wang, Liangbin Xie, Chao Dong, and Ying Shan. Real-esrgan: Training real-world blind super-resolution with pure synthetic data. In ICCVW, 2021
2021
-
[86]
Deep retinex decomposition for low-light enhancement
Chen Wei, Wenjing Wang, Wenhan Yang, and Jiaying Liu. Deep retinex decomposition for low-light enhancement. In BMVC, 2018
2018
-
[87]
Real-world image super-resolution as multi-task learning
Zhang Wenlong, Li Xiaohui, Guangyuan SHI, Chen Xiangyu, Qiao Yu, Zhang Xiaoyun, Wu Xiao-Ming, and Dong Chao. Real-world image super-resolution as multi-task learning. In NeurIPS, 2023
2023
-
[88]
Debiased all-in-one image restoration with task uncertainty regularization
Gang Wu, Junjun Jiang, Yijun Wang, Kui Jiang, and Xianming Liu. Debiased all-in-one image restoration with task uncertainty regularization. In AAAI, 2025
2025
-
[89]
Residual mixture of experts
Lemeng Wu, Mengchen Liu, Yinpeng Chen, Dongdong Chen, Xiyang Dai, and Lu Yuan. Residual mixture of experts. arXiv preprint arXiv:2204.09636, 2022
2022 arXiv
-
[90]
Mixture of loRA experts
Xun Wu, Shaohan Huang, and Furu Wei. Mixture of loRA experts. In ICLR, 2024. 34
2024
-
[91]
Towards effective multiple-in-one image restoration: A sequential and prompt learning strategy
Kong Xiangtao, Dong Chao, and Zhang Lei. Towards effective multiple-in-one image restoration: A sequential and prompt learning strategy. arXiv preprint arXiv:2401.03379, 2024
2024 arXiv
-
[92]
Finding discriminative filters for specific degradations in blind super-resolution
Liangbin Xie, Xintao Wang, Chao Dong, Zhongang Qi, and Ying Shan. Finding discriminative filters for specific degradations in blind super-resolution. In NeurIPS, 2021
2021
-
[93]
Snr-aware low-light image enhancement
Xiaogang Xu, Ruixing Wang, Chi-Wing Fu, , and Jiaya Jia. Snr-aware low-light image enhancement. In CVPR, 2022
2022
-
[95]
Hq-50k: A large-scale, high-quality dataset for image restoration
Qinhong Yang, Dongdong Chen, Zhentao Tan, Qiankun Liu, Qi Chu, Jianmin Bao, Lu Yuan, Gang Hua, and Nenghai Yu. Hq-50k: A large-scale, high-quality dataset for image restoration. arXiv preprint arXiv:2306.05390, 2023
2023 arXiv
-
[96]
Tan, Jiashi Feng, Jiaying Liu, Zongming Guo, and Shuicheng Yan
Wenhan Yang, Robby T. Tan, Jiashi Feng, Jiaying Liu, Zongming Guo, and Shuicheng Yan. Deep joint rain detection and removal from a single image. In CVPR, 2017
2017
-
[97]
Efficient degradation-aware any image restoration
Eduard Zamfir, Zongwei Wu, Nancy Mehta, Danda Dani Paudel, Yulun Zhang, and Radu Timofte. Efficient degradation-aware any image restoration. arXiv preprint arXiv:2405.15475, 2024
2024 arXiv
-
[98]
Complexity experts are task-discriminative learners for any image restoration
Eduard Zamfir, Zongwei Wu, Nancy Mehta, Yuedong Tan, Danda Pani Paudel, Yulun Zhang, and Radu Timofte. Complexity experts are task-discriminative learners for any image restoration. In CVPR, 2025
2025
-
[99]
Multi-stage progressive image restoration
Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Ming-Hsuan Yang, and Ling Shao. Multi-stage progressive image restoration. In CVPR, 2021
2021
-
[100]
Restormer: Efficient transformer for high-resolution image restoration
Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, and Ming-Hsuan Yang. Restormer: Efficient transformer for high-resolution image restoration. In CVPR, 2022
2022
-
[101]
He Zhang and Vishal M. Patel. Density-aware single image de-raining using a multi-stream dense network. In CVPR, 2018
2018
-
[102]
Ingredient- oriented multi-degradation learning for image restoration
Jinghao Zhang, Jie Huang, Mingde Yao, Zizheng Yang, Hu Yu, Man Zhou, and Feng Zhao. Ingredient- oriented multi-degradation learning for image restoration. In CVPR, 2023
2023
-
[103]
Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising
Kai Zhang, Wangmeng Zuo, Yunjin Chen, Deyu Meng, and Lei Zhang. Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE TIP, 26(7):3142–3155, 2017
2017
-
[104]
Learning a single convolutional super-resolution network for multiple degradations
Kai Zhang, Wangmeng Zuo, and Lei Zhang. Learning a single convolutional super-resolution network for multiple degradations. In CVPR, 2018
2018
-
[105]
Designing a practical degradation model for deep blind image super-resolution
Kai Zhang, Jingyun Liang, Luc Van Gool, and Radu Timofte. Designing a practical degradation model for deep blind image super-resolution. In ICCV, 2021
2021
-
[106]
Color demosaicking by local directional interpolation and nonlocal adaptive thresholding
Lei Zhang, Xiaolin Wu, Antoni Buades, and Xin Li. Color demosaicking by local directional interpolation and nonlocal adaptive thresholding. J. Electronic Imaging, 20(2):023016, 2011
2011
-
[107]
Crafting training degradation distribution for the accuracy-generalization trade-off in real-world super-resolution
Ruofan Zhang, Jinjin Gu, Haoyu Chen, Chao Dong, Yulun Zhang, and Wenming Yang. Crafting training degradation distribution for the accuracy-generalization trade-off in real-world super-resolution. In ICML, 2023
2023
-
[108]
A closer look at blind super-resolution: Degradation models, baselines, and performance upper bounds
Wenlong Zhang, Guangyuan Shi, Yihao Liu, Chao Dong, and Xiao-Ming Wu. A closer look at blind super-resolution: Degradation models, baselines, and performance upper bounds. In CVPRW, June 2022
2022
-
[109]
Learning to restore hazy video: A new real-world dataset and a new method
Xinyi Zhang, Hang Dong, Jinshan Pan, Chao Zhu, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, and Fei Wang. Learning to restore hazy video: A new real-world dataset and a new method. In CVPR, pages 9239–9248, 2021
2021
-
[110]
Con- trolvideo: Training-free controllable text-to-video generation
Yabo Zhang, Yuxiang Wei, Dongsheng Jiang, Xiaopeng Zhang, Wangmeng Zuo, and Qi Tian. Con- trolvideo: Training-free controllable text-to-video generation. arXiv preprint arXiv:2305.13077, 2023
2023 arXiv
-
[111]
Learning raw-to-srgb mappings with inaccurately aligned supervision
Zhilu Zhang, Haolin Wang, Ming Liu, Ruohao Wang, Jiawei Zhang, and Wangmeng Zuo. Learning raw-to-srgb mappings with inaccurately aligned supervision. In ICCV, 2021
2021
-
[112]
Self-supervised image restoration with blurry and noisy pairs
Zhilu Zhang, RongJian Xu, Ming Liu, Zifei Yan, and Wangmeng Zuo. Self-supervised image restoration with blurry and noisy pairs. In NeurIPS, 2022. 35
2022
-
[113]
Bracketing is all you need: Unifying image restoration and enhancement tasks with multi-exposure images
Zhilu Zhang, Shuohao Zhang, Renlong Wu, Zifei Yan, and Wangmeng Zuo. Bracketing is all you need: Unifying image restoration and enhancement tasks with multi-exposure images. arXiv preprint arXiv:2401.00766, 2024
2024 arXiv
-
[114]
Convolution meets loRA: Parameter efficient finetuning for segment anything model
Zihan Zhong, Zhiqiang Tang, Tong He, Haoyang Fang, and Chun Yuan. Convolution meets loRA: Parameter efficient finetuning for segment anything model. In ICLR, 2024
2024
-
[115]
Image restoration for under-display camera
Yuqian Zhou, David Ren, Neil Emerton, Sehoon Lim, and Timothy Large. Image restoration for under-display camera. In CVPR, 2021
2021
-
[116]
Uni-perceiver-moe: Learning sparse generalist models with conditional moes
Jinguo Zhu, Xizhou Zhu, Wenhai Wang, Xiaohua Wang, Hongsheng Li, Xiaogang Wang, and Jifeng Dai. Uni-perceiver-moe: Learning sparse generalist models with conditional moes. In NeurIPS, 2022
2022
-
[117]
Learning weather-general and weather-specific features for image restoration under multiple ad verse weather conditions
Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, and Xiaowei Hu. Learning weather-general and weather-specific features for image restoration under multiple ad verse weather conditions. In CVPR, 2023
2023
-
[118]
St-moe: Design stable and transferable sparse expert models
Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du, Yanping Huang, Jeff Dean, Noam Shazeer, and William Fedus. St-moe: Design stable and transferable sparse expert models. arXiv preprint arXiv:2202.08906, 2022. 36
2022 arXiv
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.