REVIEW 3 major objections 3 minor 50 references
Video Demoireing using Focused-Defocused Dual-Camera System
T0 review · 3 major / 3 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read A defocused second camera guides video demoireing, and the paper reports that this dual-camera approach largely outperforms existing single-camera methods.
desk verdict A plausible dual-camera demoireing framework, but the abstract alone carries no experimental evidence, so the strong claim of superiority is unbacked. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the defocused video as a physically derived prior: defocus acts as a low-pass filter that removes the high-frequency interference producing moire. Around this prior the pipeline stacks optical-flow alignment, a multi-scale CNN that ingests the aligned focused and defocused frames, a multi-dimensional training loss, and a joint bilateral filter that transfers the CNN's corrections onto the original focused frame for tonal and temporal consistency.
What would settle it
A scene with a large foreground occlusion and fast motion where optical flow alignment misaligns the two cameras: if the demoireed output shows visible ghosting or color bleeding in those regions and performs worse than a single-camera baseline, the claim that the defocused guide always helps would be contradicted.
Extended reading notes
Core claim
The central claim is that moire in video can be separated from genuine texture by exploiting a second, defocused view of the same scene. The defocused stream suppresses the high frequencies that create moire while retaining the scene's color and low-frequency structure, so it provides a physical prior that tells the network which patterns are artifacts. After optical-flow alignment to handle displacement and occlusion, the defocused frame guides a multi-scale CNN that produces a demoireed frame, and a joint bilateral filter then uses that CNN output as a guide to filter the original focused frame, preserving detail and avoiding temporal flicker. The paper's experiments assert clear gains over existing single-camera image and video demoireing methods.
Load-bearing premise
The defocused video, after optical flow alignment, still matches the focused video closely enough in structure and color; if alignment fails on occluded or fast-moving regions, the defocused guide can blur the output or inject wrong colors.
Editorial extensions
If this is right
- The defocused guide lets the network distinguish moire from real texture, which single-camera methods struggle to do because the two can look nearly identical.
- The optical-flow alignment step makes the dual-camera idea practical for video, not just still images, by compensating for displacement and occlusion between the two streams.
- The joint bilateral filter is what enforces tonal consistency and temporal coherence, so the output avoids the flicker and color shifts common in frame-by-frame demoireing.
- If the reported gains hold, any camera system that can capture a slightly defocused second view could adopt this framework to improve video quality in moire-prone scenes.
Reading between the lines
- If the method is correct as claimed, one natural extension is to smartphone or cinema dual-lens rigs, where a defocused secondary sensor could be used live or in post to demoire footage with less texture loss than software-only approaches.
- The method's dependence on optical flow alignment suggests that scenes with large parallax, heavy occlusion, or fast motion are the likely failure cases; a confidence-weighted fusion of the defocused guide might extend robustness there.
- The defocused-view trick is a general principle: a physically altered second capture that suppresses the artifact class can serve as a prior for other removal tasks, such as glare, flicker, or sensor noise, not just moire.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a dual-camera video demoireing framework in which a synchronized defocused video is used as a guide for removing moiré from a focused video. The pipeline consists of optical-flow-based alignment between focused and defocused frames, a multi-scale CNN that uses the aligned defocused frame to guide demoireing, a multi-dimensional training loss, and a final joint bilateral filter that uses the CNN output as a guide to filter the original focused frame for tonal and temporal consistency. The abstract claims that experiments show the framework largely outperforms state-of-the-art image and video demoireing methods.
Significance. If validated, the proposed idea of using a physically defocused view as a moiré-free guide is a novel and plausible approach to the texture–moiré disambiguation problem, and the joint bilateral filter is a clever mechanism for preserving tonal consistency. The concept yields a concrete, testable prediction: a defocused guide improves demoireing quality over single-camera processing. However, the manuscript as provided is abstract-only; no dataset, metrics, baselines, architecture details, or experimental results are visible, so the significance is entirely conditional. The paper does not ship reproducible code, machine-checked proofs, or any falsifiable quantitative evidence in the current form.
major comments (3)
- [Abstract, experimental results claim] The sentence "Experimental results demonstrate that our proposed framework largely outperforms state-of-the-art image and video demoireing methods" is unsupported by any visible evidence. The full text of the manuscript is blank, so there is no dataset description, no evaluation metrics, no baseline comparisons, and no implementation details. Because the claimed superiority over state-of-the-art is the central claim of the paper, this missing evidence is load-bearing and must be supplied.
- [Abstract, optical-flow alignment step] The optical-flow-based alignment between the focused and defocused views is a correctness risk: defocus blur intentionally suppresses high-frequency spatial structure, which is exactly the information most optical-flow methods rely on for correspondence. The abstract does not state whether the two cameras share a common optical path or have a stereo baseline, leaving open the possibility of parallax, occlusion, and large-displacement errors. A concrete analysis of alignment accuracy under occlusion and large displacement, along with an ablation that removes the defocused guide, is needed to support the claim that misalignment does not inject blur, ghosting, or wrong colors into the output.
- [Abstract, multi-scale CNN and training loss] The proposed method is described only at a high level: a multi-scale CNN, a multi-dimensional training loss, and a joint bilateral filter are mentioned, but no loss formulation, network architecture, training data, or hyperparameters are provided. This makes the method irreproducible from the manuscript and prevents assessment of whether the defocused guide is actually the source of any improvement. At minimum, the full paper must include the loss terms and an architecture figure.
minor comments (3)
- [Full text] The full text of the manuscript as submitted consists almost entirely of whitespace. This appears to be a submission error; a journal submission must contain the complete paper content, not merely an abstract.
- [Abstract, camera setup] The abstract does not specify whether the focused and defocused videos are captured through a common optical path or through two separate lenses, nor how synchronization is achieved. These details are essential for judging the practical feasibility and the expected magnitude of parallax and misalignment.
- [Abstract, wording] The phrase "largely outperforms" is vague; a revised paper should replace it with concrete quantitative results, including error bars or statistical significance tests, on standard demoireing benchmarks.
Circularity Check
No significant circularity: the dual-camera demoireing pipeline is an empirical method with no fitted-parameter prediction or self-citation-based derivation.
full rationale
The paper's central claim is an empirical performance comparison: a dual-camera framework using a defocused guide, optical-flow alignment, a multi-scale CNN, a multi-dimensional training loss, and a joint bilateral filter is asserted to outperform existing single-camera demoireing methods on benchmark tasks. No equations are provided in the available text, so there is no derivation chain in which an output is shown to equal an input by construction. The defocused video is an external sensory input, not a fitted parameter renamed as a prediction. The multi-dimensional training loss may contain reconstruction terms relating output to input, but that is standard supervised learning and does not make the claimed performance comparison circular. The method is evaluated against external state-of-the-art methods rather than against its own fitted values. No self-citation is visible in the abstract, and no uniqueness theorem or prior-work premise is invoked to force the design. The skeptical concern about optical-flow reliability is a correctness or robustness risk, not a circularity: it challenges whether the method works, not whether the claim reduces to its inputs. Therefore the appropriate circularity score is 0.
Assumptions & free parameters
assumptions (2)
- domain assumption Defocused capture significantly reduces moire patterns while preserving enough scene structure to serve as a guide.
- domain assumption Optical flow can align focused and defocused frames well enough across displacement and occlusion.
Cite this review
Pith. "Pith review of Video Demoireing using Focused-Defocused Dual-Camera System." pith.science (2026). https://pith.science/paper/X2ARBFRR
@misc{pith2026250803449,
author = {Pith},
title = {Pith review of: Video Demoireing using Focused-Defocused Dual-Camera System},
year = {2026},
howpublished = {\url{https://pith.science/paper/X2ARBFRR}},
note = {Machine review of arXiv:2508.03449}
}
read the original abstract
Moire patterns, unwanted color artifacts in images and videos, arise from the interference between spatially high-frequency scene contents and the spatial discrete sampling of digital cameras. Existing demoireing methods primarily rely on single-camera image/video processing, which faces two critical challenges: 1) distinguishing moire patterns from visually similar real textures, and 2) preserving tonal consistency and temporal coherence while removing moire artifacts. To address these issues, we propose a dual-camera framework that captures synchronized videos of the same scene: one in focus (retaining high-quality textures but may exhibit moire patterns) and one defocused (with significantly reduced moire patterns but blurred textures). We use the defocused video to help distinguish moire patterns from real texture, so as to guide the demoireing of the focused video. We propose a frame-wise demoireing pipeline, which begins with an optical flow based alignment step to address any discrepancies in displacement and occlusion between the focused and defocused frames. Then, we leverage the aligned defocused frame to guide the demoireing of the focused frame using a multi-scale CNN and a multi-dimensional training loss. To maintain tonal and temporal consistency, our final step involves a joint bilateral filter to leverage the demoireing result from the CNN as the guide to filter the input focused frame to obtain the final output. Experimental results demonstrate that our proposed framework largely outperforms state-of-the-art image and video demoireing methods.
Reference graph
Works this paper leans on
-
[1]
K. Nishioka, N. Hasegawa, K. Ono, and Y. Tatsuno, ``Endoscope system provided with low-pass filter for moire removal,'' Feb. 15 2000, US Patent 6,025,873
work page 2000
-
[2]
o berl, W. Schnurrer, A. Oberd \
M. Sch \"o berl, W. Schnurrer, A. Oberd \"o rster, S. F \"o el, and A. Kaup, ``Dimensioning of optical birefringent anti-alias filters for digital cameras,'' in 2010 IEEE International Conference on Image Processing, 2010, pp. 4305--4308
work page 2010
-
[3]
P. Dai, X. Yu, L. Ma, B. Zhang, J. Li, W. Li, J. Shen, and X. Qi, ``Video demoireing with relation-based temporal consistency,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 17\,622--17\,631
work page 2022
-
[4]
D. Menon and G. Calvagno, ``Color image demosaicking: An overview,'' Signal Processing: Image Communication, vol. 26, no. 8, pp. 518--533, 2011
work page 2011
-
[5]
I. Pekkucuksen and Y. Altunbasak, ``Multiscale gradients-based color filter array interpolation,'' IEEE Transactions on Image Processing, vol. 22, no. 1, pp. 157--165, 2013
work page 2013
-
[6]
Z. Wei, J. Wang, H. Nichol, S. Wiebe, and D. Chapman, ``A median-gaussian filtering framework for moir \'e pattern noise removal from x-ray microscopy image,'' Micron, vol. 43, no. 2-3, pp. 170--176, 2012
work page 2012
-
[7]
H. Siddiqui, M. Boutin, and C. A. Bouman, ``Hardware-friendly descreening,'' IEEE transactions on image processing, vol. 19, no. 3, pp. 746--757, 2009
work page 2009
-
[8]
J. Yang, X. Zhang, C. Cai, and K. Li, ``Demoir \'e ing for screen-shot images with multi-channel layer decomposition,'' in Visual Communications and Image Processing (VCIP), 2017, pp. 1--4
work page 2017
Show all 50 references
-
[9]
Y. Sun, Y. Yu, and W. Wang, ``Moiré photo restoration using multiresolution convolutional neural networks,'' IEEE Transactions on Image Processing, vol. 27, no. 8, pp. 4160--4172, 2018
2018
-
[10]
B. He, C. Wang, B. Shi, and L.-Y. Duan, ``Mop moire patterns using mopnet,'' in IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 2424--2432
2019
-
[11]
Cheng, Z
X. Cheng, Z. Fu, and J. Yang, ``Multi-scale dynamic feature encoding network for image demoir \'e ing,'' in IEEE/CVF International Conference on Computer Vision(ICCV), 2019, pp. 3486--3493
2019
-
[12]
T. Gao, Y. Guo, X. Zheng, Q. Wang, and X. Luo, ``Moir \'e pattern removal with multi-scale feature enhancing network,'' in 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2019, pp. 240--245
2019
-
[13]
Zheng, S
B. Zheng, S. Yuan, G. Slabaugh, and A. Leonardis, ``Image demoireing with learnable bandpass filters,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 3636--3645
2020
-
[14]
Zheng, S
B. Zheng, S. Yuan, C. Yan, X. Tian, J. Zhang, Y. Sun, L. Liu, A. Leonardis, and G. Slabaugh, ``Learning frequency domain priors for image demoireing,'' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 11, pp. 7705--7717, 2021
2021
-
[15]
X. Yu, P. Dai, W. Li, L. Ma, J. Shen, J. Li, and X. Qi, ``Towards efficient and scale-robust ultra-high-definition image demoir \'e ing,'' in European Conference on Computer Vision (ECCV), 2022, pp. 646--662
2022
-
[16]
L. Liu, S. Yuan, J. Liu, L. Bao, G. Slabaugh, and Q. Tian, ``Self-adaptively learning to demoir\' e from focused and defocused image pairs,'' in Advances in Neural Information Processing Systems, vol. 33, 2020, pp. 22\,282--22\,292
2020
-
[17]
H. Yue, Y. Mao, L. Liang, H. Xu, C. Hou, and J. Yang, ``Recaptured screen image demoiréing,'' IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 1, pp. 49--60, 2021
2021
-
[18]
B. He, C. Wang, B. Shi, and L.-Y. Duan, ``Fhde2net: Full high definition demoireing network,'' in European Conference on Computer Vision (ECCV), 2020, pp. 713--729
2020
-
[19]
A. G. Vien, H. Park, and C. Lee, ``Dual-domain deep convolutional neural networks for image demoireing,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 3636--3645
2020
-
[20]
L. Liu, J. Liu, S. Yuan, G. Slabaugh, A. Leonardis, W. Zhou, and Q. Tian, ``Wavelet-based dual-branch network for image demoir \'e ing,'' in European Conference on Computer Vision (ECCV), 2020, pp. 86--102
2020
-
[21]
H. Yue, Y. Cheng, Y. Mao, C. Cao, and J. Yang, ``Recaptured screen image demoiréing in raw domain,'' IEEE Transactions on Multimedia, vol. 25, pp. 5589--5600, 2023
2023
-
[22]
S. Liu, C. Li, N. Nan, Z. Zong, and R. Song, ``Mmdm: Multi-frame and multi-scale for image demoir \'e ing,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 434--435
2020
-
[23]
B. Liu, X. Shu, and X. Wu, ``Demoir \' e ing of camera-captured screen images using deep convolutional neural network,'' CoRR, vol. abs/1804.03809, 2018
2018 arXiv
-
[24]
S. Yuan, R. Timofte, G. Slabaugh, and A. Leonardis, ``Aim 2019 challenge on image demoireing: Dataset and study,'' in IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 3526--3533
2019
-
[25]
S. Yuan, R. Timofte, A. Leonardis, and G. Slabaugh, ``Ntire 2020 challenge on image demoireing: Methods and results,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 460--461
2020
-
[26]
D. Niu, R. Guo, and Y. Wang, ``Mori\' e attack (ma): A new potential risk of screen photos,'' in Advances in Neural Information Processing Systems, vol. 34, 2021, pp. 26\,117--26\,129
2021
-
[27]
L. Liu, S. Yuan, J. Liu, X. Guo, Y. Yan, and Q. Tian, ``Siamtrans: Zero-shot multi-frame image restoration with pre-trained siamese transformers,'' in AAAI Conference on Artificial Intelligence, vol. 36, no. 2, 2022, pp. 1747--1755
2022
-
[28]
D. Jeon, S. Baek, I. Choi, and M. Kim, ``Enhancing the spatial resolution of stereo images using a parallax prior,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), 2018, pp. 1721--1730
2018
-
[29]
L. Wang, Y. Wang, Z. Liang, Z. Lin, J. Yang, W. An, and Y. Guo, ``Learning parallax attention for stereo image super-resolution,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 12\,242--12\,251
2019
-
[30]
X. Dong, C. Liu, X. Hu, K. Xu, and W. Li, ``Spatially consistent transformer for colorization in monochrome-color dual-lens system,'' IEEE Transactions on Image Processing, vol. 31, pp. 6747--6760, 2022
2022
-
[31]
X. Dong, C. Liu, W. Li, X. Hu, X. Wang, and Y. Wang, ``Self-supervised colorization towards monochrome-color camera systems using cycle cnn,'' IEEE Transactions on Image Processing, vol. 30, pp. 6609--6622, 2021
2021
-
[32]
Li, C.-W
B. Li, C.-W. Lin, B. Shi, T. Huang, W. Gao, and C.-C. J. Kuo, ``Depth-aware stereo video retargeting,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), 2018, pp. 6517--6525
2018
-
[33]
S. Zhou, J. Zhang, W. Zuo, H. Xie, J. Pan, and J. S. Ren, ``Davanet: Stereo deblurring with view aggregation,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 10\,988--10\,997
2019
-
[34]
J. Wang, T. Xue, J. T. Barron, and J. Chen, ``Stereoscopic dark flash for low-light photography,'' in IEEE International Conference on Computational Photography (ICCP), 2019, pp. 1--10
2019
-
[35]
L. Pan, Y. Dai, M. Liu, and F. M. Porikli, ``Simultaneous stereo video deblurring and scene flow estimation,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6987--6996
2017
-
[36]
Huang, Q
X. Huang, Q. Zhang, Y. Feng, H. Li, X. Wang, and Q. Wang, ``Hdr-nerf: High dynamic range neural radiance fields.'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 18\,398--18\,408
2022
-
[37]
Mildenhall, P
B. Mildenhall, P. Hedman, R. Martin-Brualla, P. Srinivasan, and J. Barron, ``Nerf in the dark: High dynamic range view synthesis from noisy raw images,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 16\,190--16\,199
2022
-
[38]
Huang, X
Z. Huang, X. Shi, C. Zhang, Q. Wang, K. C. Cheung, H. Qin, J. Dai, and H. Li, ``Flowformer: A transformer architecture for optical flow,'' in European Conference on Computer Vision (ECCV), 2022, pp. 668--685
2022
-
[39]
N. S. Nagaraja, P. Ochs, K. Liu, and T. Brox, ``Hierarchy of localized random forests for video annotation,'' in Pattern Recognition, A. Pinz, T. Pock, H. Bischof, and F. Leberl, Eds. 1em plus 0.5em minus 0.4em Berlin, Heidelberg: Springer Berlin Heidelberg, 2012, pp. 21--30
2012
-
[40]
Paris and F
S. Paris and F. Durand, ``A fast approximation of the bilateral filter using a signal processing approach,'' in European Conference on Computer Vision (ECCV), 2006, pp. 568--580
2006
-
[41]
Y. Song, C. Yang, Z. Lin, X. Liu, Q. Huang, H. Li, and C.-C. J. Kuo, ``Contextual-based image inpainting: Infer, match, and translate,'' in European Conference on Computer Vision (ECCV), 2018, p. 3–18
2018
-
[42]
Z. Tu, H. Talebi, H. Zhang, F. Yang, P. Milanfar, A. Bovik, and Y. Li, ``Maxim: Multi-axis mlp for image processing,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 5769--5780
2022
-
[43]
Kang, J.-Y
M. Kang, J.-Y. Zhu, R. Zhang, J. Park, E. Shechtman, S. Paris, and T. Park, ``Scaling up gans for text-to-image synthesis,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 10\,124--10\,134
2023
-
[44]
D. J. Butler, J. Wulff, G. B. Stanley, and M. J. Black, ``A naturalistic open source movie for optical flow evaluation,'' in European Conference on Computer Vision (ECCV), A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, Eds. 1em plus 0.5em minus 0.4em Berlin, He...
2012
-
[45]
Bychkovsky, S
V. Bychkovsky, S. Paris, E. Chan, and F. Durand, ``Learning photographic global tonal adjustment with a database of input/output image pairs,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 97--104
2011
-
[46]
D. P. Kingma and J. Ba, ``Adam: A method for stochastic optimization,'' in International Conference on Learning Representations (ICLR), 2015
2015
-
[47]
Z. Wang, X. Cun, J. Bao, W. Zhou, J. Liu, and H. Li, ``Uformer: A general u-shaped transformer for image restoration,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 17\,683--17\,693
2022
-
[48]
Liang, J
J. Liang, J. Cao, G. Sun, K. Zhang, L. Van Gool, and R. Timofte, ``Swinir: Image restoration using swin transformer,'' in IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 1833--1844
2021
-
[49]
Godard, K
C. Godard, K. Matzen, and M. Uyttendaele, ``Deep burst denoising,'' in European Conference on Computer Vision (ECCV), 2018, pp. 538--554
2018
-
[50]
Z. Xia, F. Perazzi, M. Gharbi, K. Sunkavalli, and A. Chakrabarti, ``Basis prediction networks for effective burst denoising with large kernels,'' in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 11\,844--11\,853
2020
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.