{"id":"a0df1be9-682f-464b-b18f-6e59a8a81db1","arxiv_id":"2604.10634","paper_version":2,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":2.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"The NTIRE 2026 challenge reports strong performance from 17 teams on raindrop removal for dual-focused day and night images using an adjusted real-world dataset with 14,139 training images.","lead":"This paper overviews the NTIRE 2026 challenge on removing raindrops from day and night dual-focused images using the Raindrop Clarity dataset. A smart generalist might read it to see current benchmarks and team results for practical image restoration in adverse weather.","discovery_kind":"review","skeptic_critique":{"model":"grok-4.3","headline":"No significant objection identified","rationale":"The reader's weakest assumption correctly flags a generalizability question, yet that question lies outside the paper's narrow claim of benchmark performance. No factual inconsistency, missing baseline, or unverifiable number appears in the supplied text that would alter the UNVERDICTED status.","tokens_in":1657,"tokens_out":253,"duration_ms":19374,"concrete_test":"Reproduce the top-three reported scores from the results table using the exact test split and evaluation protocol stated in the paper; if the numbers match within 0.1 dB / 0.001 SSIM the reported performance is internally consistent.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper is a standard challenge overview whose central claim is simply that 17 submitted methods reached strong performance on the provided Raindrop Clarity test set. No internal derivation, proof, or novel technical assertion is present; the text reports participation numbers, split sizes, and a high-level performance statement. Because the claim is scoped to results on this specific benchmark rather than a general assertion about real-world efficacy, the representativeness of the 593-image test split is not load-bearing for the paper's actual content.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"This paper presents an overview of the NTIRE 2026 Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images. It describes adjustments to the Raindrop Clarity dataset (14,139 training images, 407 validation images, 593 test images), notes that 168 teams registered with 17 submitting valid final solutions and fact sheets, and states that the submitted methods achieved strong performance on the dataset, demonstrating progress in the task.","tokens_in":1716,"tokens_out":325,"duration_ms":22758,"significance":"If the performance claims are substantiated, the paper is significant as a community benchmark report that documents participation and progress on real-world raindrop removal under varying illumination and focus conditions. Such challenge overviews help standardize evaluation and encourage development of practical restoration methods.","major_comments":[{"comment":"Abstract: The central claim that 'the submitted methods achieved strong performance' is unsupported by any quantitative metrics (e.g., PSNR, SSIM), baseline comparisons, or error analysis. Without these, the assertion cannot be evaluated and is load-bearing for the paper's contribution as a challenge summary.","section":null}],"minor_comments":[{"comment":"The dataset citation is given only as ~cite{jin2024raindrop}; the full bibliographic reference should be included in the reference list.","section":null},{"comment":"The term 'dual-focused images' is used without definition or explanation of how focus conditions are varied in the Raindrop Clarity dataset.","section":null}],"recommendation":"major_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for the constructive feedback. We agree that the abstract requires quantitative support for the performance claim and will revise the manuscript accordingly to strengthen the presentation of results.","responses":[{"response":"We agree that the abstract should be self-contained and include specific quantitative metrics. The full manuscript already reports detailed PSNR, SSIM, and other evaluation results for all 17 submitted methods in dedicated tables (with baseline comparisons), but these are not summarized in the abstract. In the revision we will add the top achieved PSNR and SSIM values, along with a brief note on the range of performance across submissions, directly into the abstract to substantiate the claim.","revision_made":"yes","referee_comment":"Abstract: The central claim that 'the submitted methods achieved strong performance' is unsupported by any quantitative metrics (e.g., PSNR, SSIM), baseline comparisons, or error analysis. Without these, the assertion cannot be evaluated and is load-bearing for the paper's contribution as a challenge summary."}],"tokens_in":1207,"tokens_out":231,"duration_ms":19023,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"This paper is the official summary for the second NTIRE challenge on day and night raindrop removal from dual-focused images. It updates the Raindrop Clarity dataset to 14,139 training images, 407 validation, and 593 test images, notes that 168 teams registered and 17 submitted valid solutions, and states that those solutions reached strong performance on the test set. The goal is framed as building a practical benchmark for real illumination and focus conditions that matter for applications like driving or surveillance. What the paper does well is simply documenting participation numbers and keeping the shared evaluation setup alive for the community. Challenge reports like this avoid the need for every new paper to re-create a testbed from scratch. The main limitation is that the text supplies no numbers, no baselines, no comparison to the first edition, and no error analysis. The claim of strong performance stays at the level of an assertion rather than evidence that can be checked from the document itself. If the full version includes tables and method summaries, that would change the picture, but the provided content does not. The representativeness of the 593-image test split for every possible real-world raindrop scenario is taken as given rather than demonstrated. This paper is mainly useful for people who track the NTIRE series or need the current benchmark numbers for context in their own deraining work. Readers hunting for new algorithms will have to turn to the individual team submissions instead. It shows clear, factual engagement with the task and the literature on image restoration, with no internal contradictions or invented claims. I would send it to peer review rather than desk reject it, because these challenge reports set the reference point for the field even when they are mostly descriptive.","headline":"This is a standard NTIRE challenge overview that updates the Raindrop Clarity dataset splits and reports 17 submissions but gives no quantitative results or analysis.","tokens_in":2604,"tokens_out":413,"would_cite":false,"duration_ms":21689,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":{"model":"grok-4.3","evidence":[],"headline":"Standard CV challenge report with zero RS overlap","alignment":"orthogonal","rationale":"The paper is a benchmark overview reporting participation numbers, dataset splits (14k/407/593), and leaderboard metrics (PSNR/SSIM/LPIPS) for 17 neural-network submissions on the Raindrop Clarity dataset. Its machinery consists of standard restoration backbones (Restormer, MSDT, NAFNet, etc.), pseudo-GT fusion, and a composite score; none of these structures invoke J-cost, φ-ladders, 8-tick periodicity, or any RS forcing theorem. The domain (empirical image restoration) lies outside the RS scope.","tokens_in":59261,"confidence":"high","tokens_out":158,"duration_ms":9096,"cache_read_input_tokens":38528,"cache_creation_input_tokens":0},"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"The NTIRE 2026 challenge shows that submitted methods achieve strong performance on the Raindrop Clarity dataset for day and night raindrop removal in dual-focused images.","keywords":["raindrop removal","image restoration","NTIRE challenge","dual-focused images","day and night conditions","real-world dataset","computer vision benchmark"],"falsifier":"New dual-focused images collected independently under day and night rain conditions where the top challenge methods produce visibly incomplete raindrop removal or introduce new artifacts.","tokens_in":2548,"feed_emoji":"🖼️","tokens_out":601,"duration_ms":31212,"temperature":0.7,"pith_summary":"This paper gives an overview of the second NTIRE challenge focused on removing raindrops from images captured under day and night lighting with dual focus settings. It describes an updated real-world dataset called Raindrop Clarity that includes 14,139 training images, 407 validation images, and 593 test images. Out of 168 registered teams, 17 submitted valid solutions and fact sheets that performed strongly on the test set. The report frames these results as evidence of growing progress in the task. A reader would care because the challenge supplies a concrete benchmark for developing image restoration methods that work in practical outdoor conditions.","feed_headline":"NTIRE 2026 challenge reports strong raindrop removal results","feed_subtitle":"17 valid submissions perform well on the updated Raindrop Clarity dataset for dual-focused day and night images.","key_machinery":"The Raindrop Clarity dataset with its train, validation, and test splits functions as the evaluation benchmark that all submitted methods are measured against.","core_discovery":"The central claim is that the 17 submitted methods achieved strong performance on the Raindrop Clarity dataset, demonstrating growing progress in raindrop removal under various illumination and focus conditions. The paper presents the adjusted dataset splits and the participation numbers as the basis for this conclusion, positioning the challenge as a practical benchmark for the field.","pith_inferences":["Methods successful on this dataset could be tested for generalization to other weather degradations such as fog or snow.","The dataset splits could be expanded with more varied scenes to check whether current performance holds outside the provided distribution.","Integration of these removal techniques into camera pipelines might reduce post-processing needs for outdoor photography."],"forward_implications":["The benchmark allows standardized comparison of future raindrop removal algorithms on the same real-world data.","Strong results support continued development of methods that handle combined illumination and focus variations.","The challenge format encourages broader participation in solving this specific image restoration problem."],"fun_headline_variants":["NTIRE 2026 challenge has 17 raindrop removal submissions","17 valid solutions on Raindrop Clarity day night images","Updated dataset benchmarks 17 dual-focused methods","NTIRE 2026 reports raindrop removal results from 17 teams"],"cache_read_input_tokens":64,"weakest_assumption_plain":"The adjusted Raindrop Clarity dataset with its specific train/validation/test splits sufficiently represents the full range of real-world day and night raindrop conditions on dual-focused images.","fun_headline_variants_meta":{"raw":{"variants":["NTIRE 2026 challenge has 17 raindrop removal submissions","17 valid solutions on Raindrop Clarity day night images","Updated dataset benchmarks 17 dual-focused methods","NTIRE 2026 reports raindrop removal results from 17 teams"]},"model":"grok-4.3","cost_usd":0.006787,"raw_usage":{"total_tokens":3039,"prompt_tokens":595,"num_sources_used":0,"completion_tokens":66,"cost_in_usd_ticks":67865500,"prompt_tokens_details":{"text_tokens":595,"audio_tokens":0,"image_tokens":0,"cached_tokens":64},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":2378,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":595,"tokens_out":66,"duration_ms":35183,"temperature":1.0,"reasoning_tokens":2378,"cache_read_input_tokens":64,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-05-14T21:22:31.023462+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"New dual-focused images collected independently under day and night rain conditions where the top challenge methods produce visibly incomplete raindrop removal or introduce new artifacts.","supporting_citations":[],"review_version":2}