REVIEW 3 major objections 2 minor 108 references
MetaScope: Optics-Driven Neural Network for Ultra-Micro Metalens Endoscopy
T0 review · 3 major / 2 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read MetaScope claims an optics-driven neural network that restores and segments metalens endoscopic images, correcting brightness decay and chromatic blur with learned Point Spread Function priors, and reports gains over state-of-the-art plus…
desk verdict Plausible and potentially useful new application for metalens endoscopy, but the corrupted full text leaves the central simulation-to-reality premise unverifiable. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the learned Point Spread Function (PSF) — the way a single bright point smears into a blob after passing through the metalens — used per color channel as the bridge between raw physics and image correction. OIA encodes the optical state of each pixel into embeddings and adjusts intensities to counteract decay; OCC predicts per-channel PSFs, converts them into spatial deformation fields, and applies those fields to bring blurred color channels back into registration. Because both modules are conditioned on optics rather than on dataset statistics alone, the network can invert known degradations instead of memorizing paired examples; the gradient-guided distillation then aligns the corrected features with semantic knowledge from a pretrained foundational model so that segmentation and restoration improve together.
What would settle it
Measure the real metalens point spread function with a point-source phantom at several wavelengths, run MetaScope on the measured PSFs, and compare its chromatic correction to the observed blur; systematic disagreement at any wavelength, or degraded segmentation on a calibrated resolution target imaged through the real lens, would show the simulation-to-real link is missing.
Extended reading notes
Core claim
The central claim is that a neural network driven by physical optics can simultaneously restore and segment metalens endoscopic images better than current state-of-the-art methods, and that it carries over to real biomedical scenes. The paper identifies two artifacts from preliminary optical simulation: intensity decay across the field and chromatic aberration from wavelength-dependent focusing. MetaScope handles these with two modules: Optics-informed Intensity Adjustment (OIA), which learns optical embeddings that rectify brightness decay, and Optics-informed Chromatic Correction (OCC), which learns spatial deformations guided by learned Point Spread Function (PSF) distributions to realign color channels. Gradient-guided distillation transfers knowledge from a pretrained foundational model into the joint learning, which the authors argue is what gives the system its adaptive generalization. The restoration and segmentation results are reported as superior to prior methods, with real-scene generalization as the headline outcome.
Load-bearing premise
The whole correction rests on the assumption that the simulated optics and the learned Point Spread Function distributions faithfully describe how a real metalens forms images, so any gap between simulation and physical hardware would break the claimed real-scene generalization.
Editorial extensions
If this is right
- Metalens endoscopes could be paired with software correction, removing the need for multi-element conventional optics in micro-imaging devices.
- Restoration and segmentation can be trained jointly with optical priors, so clinical analysis would run directly on corrected metalens images rather than on raw artifact-laden frames.
- The approach reduces reliance on large real metalens datasets, because the network starts from simulated optical priors and uses distillation to adapt.
- If the real-scene results hold, the same optics-driven structure could be adapted to other meta-optics hardware beyond endoscopy, such as wearable or capsule imaging.
Reading between the lines
- Editorial inference: a crisp way to separate physics from memorization would be to train OCC on simulated PSFs from one metalens design and test on real images from a different design; if transfer survives, the PSF prior is doing the work the paper claims.
- Editorial inference: the two-module split suggests a co-design loop — given a simulated metalens design, one could predict its artifacts and tune the nanostructure to minimize what OIA and OCC cannot correct, a design cycle the paper does not run.
- Editorial inference: since OIA and OCC operate from optical embeddings rather than hardware identity, the approach might transfer to other wavefront errors such as defocus or astigmatism, but the paper does not test that.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes MetaScope, a neural network for joint segmentation and restoration of ultra-micro metalens endoscopic images. It introduces two optics-informed modules: OIA, which rectifies intensity decay via learned optical embeddings, and OCC, which corrects chromatic aberration through spatial deformations guided by learned PSF distributions. The authors also report constructing metalens endoscopy datasets and using gradient-guided distillation from a foundational model to improve joint learning. The abstract claims state-of-the-art performance in both segmentation and restoration and 'impressive generalized ability in real biomedical scenes.'
Significance. The paper targets a real and timely problem: the mismatch between conventional endoscopy image-processing methods and the distinct physical aberrations of metalens optics. The proposed architecture is a sensible and potentially useful design: rather than applying a generic restoration network, it explicitly encodes optical priors for intensity falloff and chromatic aberration. If the performance claims are verified, the dataset and method would be a meaningful contribution to computational imaging and meta-optics. However, the supplied full text is unreadable due to encoding corruption, and the central assumption that simulated PSF distributions faithfully represent real metalens optics remains unverified, so I cannot currently assign high confidence to the reported results.
major comments (3)
- [Full text (entire manuscript)] The full text supplied for review is corrupted by encoding errors and is unreadable; only the abstract is intelligible. I cannot inspect the method formulation, the PSF simulation details, the dataset construction, the baseline comparisons, the quantitative tables, or the real-scene experiments. This prevents verification of the central claims that MetaScope 'outperforms state-of-the-art methods' and 'achieves impressive generalized ability in real biomedical scenes.' The authors should ensure that a clean, readable PDF is available for review, with all equations, figures, and tables intact.
- [Abstract] The central mechanism depends on the fidelity of the 'preliminary optical simulation' and the 'learned PSF distributions' to real metalens image formation. If these distributions are learned from simulated data only, the OIA and OCC modules may fit the simulator rather than the physical degradations of a fabricated metalens. Please provide a concrete validation of the simulated PSFs against measured PSFs, specify the simulation model (e.g., scalar/vectorial, inclusion of meta-atom dispersion and fabrication tolerances), and report real-capture results with paired ground truth or an otherwise clear evaluation protocol. This is a requested test rather than a claim of circularity.
- [Abstract] The claim of outperforming state-of-the-art methods requires a full description of the evaluation protocol. The abstract mentions 'datasets for metalens endoscopy' but does not state whether the data are simulated, real-capture, or hybrid; how ground-truth segmentation and restoration targets were obtained; which baselines were compared; and whether error bars or statistical significance tests support the reported gains. The unreadable full text does not allow me to verify any of these details. Please specify dataset composition, metrics, baseline configurations, and variance or significance measures.
minor comments (2)
- [Abstract] The phrase 'micro-level clinical' is vague; consider rewording to 'micro-scale clinical imaging' or a similar precise expression.
- [Abstract] The phrase 'learning optical embeddings' is ambiguous: it could mean embeddings learned from simulated optics or learned end-to-end from data. A brief clarification would help readers understand what is 'optics-driven' versus 'learned.'
Circularity Check
No circular step identified; the abstract describes a learned optics-informed network, not a derivation whose output equals its input.
full rationale
The available readable text (the abstract, with the full text corrupted by mojibake) does not exhibit any load-bearing circular step under the quote-based standard required here. MetaScope is an empirical neural-network method: Optics-informed Intensity Adjustment (OIA) and Optics-informed Chromatic Correction (OCC) are learned modules whose designs are inspired by physical optics, and the abstract does not claim to derive a physical prediction from a fitted parameter. The paper states that OCC learns spatial deformations informed by learned Point Spread Function (PSF) distributions, but this is a learned representation rather than a definitional identity between an input and a predicted output. The most plausible circularity concern would be evaluating the network on simulated images generated from the same PSF model used to train it, but the abstract instead claims 'impressive generalized ability in real biomedical scenes,' which points away from same-simulator evaluation. Because the full text is unreadable, no equation or self-citation chain can be quoted to exhibit a specific reduction, and unverifiability is a correctness risk rather than demonstrated circularity. Accordingly, no circularity is found and the score is 0.
Assumptions & free parameters
free parameters (2)
- Point spread function distribution parameters =
learned during MetaScope training
- Optical intensity decay embeddings =
learned during MetaScope training
assumptions (3)
- domain assumption The optical simulation used to create datasets is an accurate model of physical metalens imaging.
- domain assumption Learned PSF distributions are representative of chromatic aberrations in both simulated and real metalens imagery.
- ad hoc to paper Gradient-guided distillation from a foundational model provides useful knowledge without distorting the optics-specific training signal.
Cite this review
Pith. "Pith review of MetaScope: Optics-Driven Neural Network for Ultra-Micro Metalens Endoscopy." pith.science (2026). https://pith.science/paper/4CQVYFKS
@misc{pith2026250803596,
author = {Pith},
title = {Pith review of: MetaScope: Optics-Driven Neural Network for Ultra-Micro Metalens Endoscopy},
year = {2026},
howpublished = {\url{https://pith.science/paper/4CQVYFKS}},
note = {Machine review of arXiv:2508.03596}
}
read the original abstract
Miniaturized endoscopy has advanced accurate visual perception within the human body. Prevailing research remains limited to conventional cameras employing convex lenses, where the physical constraints with millimetre-scale thickness impose serious impediments on the micro-level clinical. Recently, with the emergence of meta-optics, ultra-micro imaging based on metalenses (micron-scale) has garnered great attention, serving as a promising solution. However, due to the physical difference of metalens, there is a large gap in data acquisition and algorithm research. In light of this, we aim to bridge this unexplored gap, advancing the novel metalens endoscopy. First, we establish datasets for metalens endoscopy and conduct preliminary optical simulation, identifying two derived optical issues that physically adhere to strong optical priors. Second, we propose MetaScope, a novel optics-driven neural network tailored for metalens endoscopy driven by physical optics. MetaScope comprises two novel designs: Optics-informed Intensity Adjustment (OIA), rectifying intensity decay by learning optical embeddings, and Optics-informed Chromatic Correction (OCC), mitigating chromatic aberration by learning spatial deformations informed by learned Point Spread Function (PSF) distributions. To enhance joint learning, we further deploy a gradient-guided distillation to transfer knowledge from the foundational model adaptively. Extensive experiments demonstrate that MetaScope not only outperforms state-of-the-art methods in both metalens segmentation and restoration but also achieves impressive generalized ability in real biomedical scenes.
Reference graph
Works this paper leans on
-
[1]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION format.date year duplicate empty "emp...
-
[2]
Endoscopy artifact detection (EAD 2019) challenge dataset
Sharib Ali, Felix Zhou, Christian Daul, Barbara Braden, Adam Bailey, Stefano Realdon, James East, Georges Wagnieres, Victor Loschenov, Enrico Grisan, et al. Endoscopy artifact detection (ead 2019) challenge dataset. arXiv preprint arXiv:1905.03209, 2019
work page Pith review arXiv 2019
-
[3]
Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge
Sharib Ali, Noha Ghatwary, Debesh Jha, Ece Isik-Polat, Gorkem Polat, Chen Yang, Wuyang Li, Adrian Galdran, Miguel- \'A ngel Gonz \'a lez Ballester, Vajira Thambawita, et al. Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge. Scientific Reports, 14 0 (1): 0 2032, 2024
2024
-
[4]
2017 robotic instrument segmentation challenge
Max Allan, Alex Shvets, Thomas Kurmann, Zichen Zhang, Rahul Duggal, Yun-Hsuan Su, Nicola Rieke, Iro Laina, Niveditha Kalavakonda, Sebastian Bodenstedt, et al. 2017 robotic instrument segmentation challenge. arXiv preprint arXiv:1902.06426, 2019
arXiv 2017
-
[5]
2018 robotic scene segmentation challenge
Max Allan, Satoshi Kondo, Sebastian Bodenstedt, Stefan Leger, Rahim Kadkhodamohammadi, Imanol Luengo, Felix Fuentes, Evangello Flouty, Ahmed Mohammed, Marius Pedersen, et al. 2018 robotic scene segmentation challenge. arXiv preprint arXiv:2001.11190, 2020
arXiv 2018
-
[6]
Deep convolutional neural networks to predict mutual coupling effects in metasurfaces
Sensong An, Bowen Zheng, Mikhail Y Shalaginov, Hong Tang, Hang Li, Li Zhou, Yunxi Dong, Mohammad Haerinia, Anuradha Murthy Agarwal, Clara Rivero-Baleine, et al. Deep convolutional neural networks to predict mutual coupling effects in metasurfaces. Advanced Optical Materials, 10 0 (3): 0 2102113, 2022
2022
-
[7]
Medical image segmentation review: The success of u-net
Reza Azad, Ehsan Khodapanah Aghdam, Amelie Rauland, Yiwei Jia, Atlas Haddadi Avval, Afshin Bozorgpour, Sanaz Karimijafarbigloo, Joseph Paul Cohen, Ehsan Adeli, and Dorit Merhof. Medical image segmentation review: The success of u-net. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024
2024
-
[8]
Towards automatic polyp detection with a polyp appearance model
Jorge Bernal, Javier S \'a nchez, and Fernando Vilarino. Towards automatic polyp detection with a polyp appearance model. Pattern Recognition, 45 0 (9): 0 3166--3182, 2012
2012
Show all 108 references
-
[9]
Wm-dova maps for accurate polyp highlighting in colonoscopy: Validation vs
Jorge Bernal, F Javier S \'a nchez, Gloria Fern \'a ndez-Esparrach, Debora Gil, Cristina Rodr \' guez, and Fernando Vilari \ n o. Wm-dova maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians. Computerized medical imaging and graphic...
2015
-
[10]
Hyperkvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy
Hanna Borgli, Vajira Thambawita, Pia H Smedsrud, Steven Hicks, Debesh Jha, Sigrun L Eskeland, Kristin Ranheim Randel, Konstantin Pogorelov, Mathias Lux, Duc Tien Dang Nguyen, et al. Hyperkvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy...
2020
-
[11]
Principles of optics: electromagnetic theory of propagation, interference and diffraction of light
Max Born and Emil Wolf. Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Elsevier, 2013
2013
-
[12]
Transunet: Transformers make strong encoders for medical image segmentation
Jieneng Chen, Yongyi Lu, Qihang Yu, Xiangde Luo, Ehsan Adeli, Yan Wang, Le Lu, Alan L Yuille, and Yuyin Zhou. Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306, 2021
2021 arXiv
-
[13]
Simple baselines for image restoration
Liangyu Chen, Xiaojie Chu, Xiangyu Zhang, and Jian Sun. Simple baselines for image restoration. In European conference on computer vision, pages 17--33. Springer, 2022 a
2022
-
[14]
Encoder-decoder with atrous separable convolution for semantic image segmentation
Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV), pages 801--818, 2018 a
2018
-
[15]
Artificial intelligence in meta-optics
Mu Ku Chen, Xiaoyuan Liu, Yanni Sun, and Din Ping Tsai. Artificial intelligence in meta-optics. Chemical Reviews, 122 0 (19): 0 15356--15413, 2022 b
2022
-
[16]
A meta-device for intelligent depth perception
Mu Ku Chen, Xiaoyuan Liu, Yongfeng Wu, Jingcheng Zhang, Jiaqi Yuan, Zhengnan Zhang, and Din Ping Tsai. A meta-device for intelligent depth perception. Advanced Materials, 35 0 (34): 0 2107465, 2023 a
2023
-
[17]
A broadband achromatic metalens for focusing and imaging in the visible
Wei Ting Chen, Alexander Y Zhu, Vyshakh Sanjeev, Mohammadreza Khorasaninejad, Zhujun Shi, Eric Lee, and Federico Capasso. A broadband achromatic metalens for focusing and imaging in the visible. Nature nanotechnology, 13 0 (3): 0 220--226, 2018 b
2018
-
[18]
Bidirectional multi-scale implicit neural representations for image deraining
Xiang Chen, Jinshan Pan, and Jiangxin Dong. Bidirectional multi-scale implicit neural representations for image deraining. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 25627--25636, 2024
2024
-
[19]
Medical federated learning with joint graph purification for noisy label learning
Zhen Chen, Wuyang Li, Xiaohan Xing, and Yixuan Yuan. Medical federated learning with joint graph purification for noisy label learning. Medical Image Analysis, 90: 0 102976, 2023 b
2023
-
[20]
Schwing, Alexander Kirillov, and Rohit Girdhar
Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov, and Rohit Girdhar. Masked-attention mask transformer for universal image segmentation. In CVPR, 2022
2022
-
[21]
In vivo intelligent fluorescence endo-microscopy by varifocal meta-device and deep learning
Yu-Hsin Chia, Wei-Hao Liao, Sunil Vyas, Cheng Hung Chu, Takeshi Yamaguchi, Xiaoyuan Liu, Takuo Tanaka, Yi-You Huang, Mu Ku Chen, Wen-Shiang Chen, et al. In vivo intelligent fluorescence endo-microscopy by varifocal meta-device and deep learning. Advanced Science, 11 0 (20): 0 ...
2024
-
[22]
3d u-net: learning dense volumetric segmentation from sparse annotation
\"O zg \"u n C i c ek, Ahmed Abdulkadir, Soeren S Lienkamp, Thomas Brox, and Olaf Ronneberger. 3d u-net: learning dense volumetric segmentation from sparse annotation. In Medical Image Computing and Computer-Assisted Intervention--MICCAI 2016: 19th International Conference, At...
2016
-
[23]
Second-order attention network for single image super-resolution
Tao Dai, Jianrui Cai, Yongbing Zhang, Shu-Tao Xia, and Lei Zhang. Second-order attention network for single image super-resolution. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11065--11074, 2019
2019
-
[24]
Achromatic single metalens imaging via deep neural network
Yunxi Dong, Bowen Zheng, Hang Li, Hong Tang, Huan Zhao, Yi Huang, Sensong An, and Hualiang Zhang. Achromatic single metalens imaging via deep neural network. ACS Photonics, 11 0 (4): 0 1645--1656, 2024
2024
-
[25]
Selective feature aggregation network with area-boundary constraints for polyp segmentation
Yuqi Fang, Cheng Chen, Yixuan Yuan, and Kai-yu Tong. Selective feature aggregation network with area-boundary constraints for polyp segmentation. In Medical Image Computing and Computer Assisted Intervention--MICCAI 2019: 22nd International Conference, Shenzhen, China, October...
2019
-
[26]
Mambair: A simple baseline for image restoration with state-space model
Hang Guo, Jinmin Li, Tao Dai, Zhihao Ouyang, Xudong Ren, and Shu-Tao Xia. Mambair: A simple baseline for image restoration with state-space model. In European Conference on Computer Vision, pages 222--241. Springer, 2024
2024
-
[27]
Segnext: Rethinking convolutional attention design for semantic segmentation
Meng-Hao Guo, Cheng-Ze Lu, Qibin Hou, Zhengning Liu, Ming-Ming Cheng, and Shi-Min Hu. Segnext: Rethinking convolutional attention design for semantic segmentation. arXiv preprint arXiv:2209.08575, 2022
2022 arXiv
-
[28]
Single image haze removal using dark channel prior
Kaiming He, Jian Sun, and Xiaoou Tang. Single image haze removal using dark channel prior. IEEE transactions on pattern analysis and machine intelligence, 33 0 (12): 0 2341--2353, 2010
2010
-
[29]
Learn2reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning
Alessa Hering, Lasse Hansen, Tony CW Mok, Albert CS Chung, Hanna Siebert, Stephanie H \"a ger, Annkristin Lange, Sven Kuckertz, Stefan Heldmann, Wei Shao, et al. Learn2reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep...
2022
-
[30]
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33: 0 6840--6851, 2020
2020
-
[31]
High-resolution metalens imaging with sequential artificial intelligence models
Wei-Lun Hsu, Chen-Fu Huang, Chih-Chun Tan, Noreena Yi-Chin Liu, Cheng Hung Chu, Po-Sheng Huang, Pin Chieh Wu, Shang Jyh Yiin, Takuo Tanaka, Chun-Jen Weng, et al. High-resolution metalens imaging with sequential artificial intelligence models. Nano letters, 23 0 (24): 0 11614--...
2023
-
[32]
Multi-view masked contrastive representation learning for endoscopic video analysis
Kai Hu, Ye Xiao, Yuan Zhang, and Xieping Gao. Multi-view masked contrastive representation learning for endoscopic video analysis. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024
2024
-
[33]
nnu-net: a self-configuring method for deep learning-based biomedical image segmentation
Fabian Isensee, Paul F Jaeger, Simon AA Kohl, Jens Petersen, and Klaus H Maier-Hein. nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature methods, 18 0 (2): 0 203--211, 2021
2021
-
[34]
Kvasir-seg: A segmented polyp dataset
Debesh Jha, Pia H Smedsrud, Michael A Riegler, P l Halvorsen, Thomas De Lange, Dag Johansen, and H vard D Johansen. Kvasir-seg: A segmented polyp dataset. In MultiMedia modeling: 26th international conference, MMM 2020, Daejeon, South Korea, January 5--8, 2020, proceedings, pa...
2020
-
[35]
Kvasir-instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endoscopy
Debesh Jha, Sharib Ali, Krister Emanuelsen, Steven A Hicks, Vajira Thambawita, Enrique Garcia-Ceja, Michael A Riegler, Thomas de Lange, Peter T Schmidt, H vard D Johansen, et al. Kvasir-instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endosc...
2021
-
[36]
Free-form diffractive metagrating design based on generative adversarial networks
Jiaqi Jiang, David Sell, Stephan Hoyer, Jason Hickey, Jianji Yang, and Jonathan A Fan. Free-form diffractive metagrating design based on generative adversarial networks. ACS nano, 13 0 (8): 0 8872--8878, 2019
2019
-
[37]
When fast fourier transform meets transformer for image restoration
Xingyu Jiang, Xiuhui Zhang, Ning Gao, and Yue Deng. When fast fourier transform meets transformer for image restoration. In European conference on computer vision. Springer, 2024
2024
-
[38]
Secure, privacy-preserving and federated machine learning in medical imaging
Georgios A Kaissis, Marcus R Makowski, Daniel R \"u ckert, and Rickmer F Braren. Secure, privacy-preserving and federated machine learning in medical imaging. Nature Machine Intelligence, 2 0 (6): 0 305--311, 2020
2020
-
[39]
Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging
Mohammadreza Khorasaninejad, Wei Ting Chen, Robert C Devlin, Jaewon Oh, Alexander Y Zhu, and Federico Capasso. Metalenses at visible wavelengths: Diffraction-limited focusing and subwavelength resolution imaging. Science, 352 0 (6290): 0 1190--1194, 2016
2016
-
[40]
Accurate image super-resolution using very deep convolutional networks
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee. Accurate image super-resolution using very deep convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1646--1654, 2016
2016
-
[41]
Auto-encoding variational bayes
Diederik P Kingma. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013
2013 arXiv
-
[42]
Computer-aided detection of bleeding regions for capsule endoscopy images
Baopu Li and Max Q-H Meng. Computer-aided detection of bleeding regions for capsule endoscopy images. IEEE Transactions on biomedical engineering, 56 0 (4): 0 1032--1039, 2009
2009
-
[43]
Flaws can be applause: Unleashing potential of segmenting ambiguous objects in sam
Chenxin Li, Wuyang Li, Hengyu Liu, Xinyu Liu, Qing Xu, Zhen Chen, Yue Huang, and Yixuan Yuan. Flaws can be applause: Unleashing potential of segmenting ambiguous objects in sam. Advances in Neural Information Processing Systems, 37: 0 45578--45599, 2024 a
2024
-
[44]
Endora: Video generation models as endoscopy simulators
Chenxin Li, Hengyu Liu, Yifan Liu, Brandon Y Feng, Wuyang Li, Xinyu Liu, Zhen Chen, Jing Shao, and Yixuan Yuan. Endora: Video generation models as endoscopy simulators. In International conference on medical image computing and computer-assisted intervention, pages 230--240. S...
2024
-
[45]
U-kan makes strong backbone for medical image segmentation and generation
Chenxin Li, Xinyu Liu, Wuyang Li, Cheng Wang, Hengyu Liu, and Yixuan Yuan. U-kan makes strong backbone for medical image segmentation and generation. arXiv preprint arXiv:2406.02918, 2024 c
2024 arXiv
-
[46]
Dual-layer achromatic metalens design with an effective abbe number
Mengmeng Li, Shuaishuai Li, Lip Ket Chin, Yefeng Yu, Din Ping Tsai, and Rushan Chen. Dual-layer achromatic metalens design with an effective abbe number. Opt. Express, 28 0 (18): 0 26041--26055, 2020
2020
-
[47]
Revolutionary meta-imaging: from superlens to metalens
Tao Li, Chen Chen, Xingjian Xiao, Ji Chen, Shanshan Hu, and Shining Zhu. Revolutionary meta-imaging: from superlens to metalens. Photonics Insights, 2 0 (1): 0 R01--R01, 2023 a
2023
-
[48]
Joint polyp detection and segmentation with heterogeneous endoscopic data
Wuyang Li, Yang Chen, Jie Liu, Xinyu Liu, Xiaoqing Guo, and Yixuan Yuan. Joint polyp detection and segmentation with heterogeneous endoscopic data. In 3rd International Workshop and Challenge on Computer Vision in Endoscopy (EndoCV 2021): co-located with the 17th IEEE Internat...
2021
-
[49]
Scan: Cross domain object detection with semantic conditioned adaptation
Wuyang Li, Xinyu Liu, Xiwen Yao, and Yixuan Yuan. Scan: Cross domain object detection with semantic conditioned adaptation. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 1421--1428, 2022 a
2022
-
[50]
Sigma: Semantic-complete graph matching for domain adaptive object detection
Wuyang Li, Xinyu Liu, and Yixuan Yuan. Sigma: Semantic-complete graph matching for domain adaptive object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5291--5300, 2022 b
2022
-
[51]
Novel scenes & classes: Towards adaptive open-set object detection
Wuyang Li, Xiaoqing Guo, and Yixuan Yuan. Novel scenes & classes: Towards adaptive open-set object detection. In Proceedings of the IEEE/CVF international conference on computer vision, pages 15780--15790, 2023 b
2023
-
[52]
Sigma++: Improved semantic-complete graph matching for domain adaptive object detection
Wuyang Li, Xinyu Liu, and Yixuan Yuan. Sigma++: Improved semantic-complete graph matching for domain adaptive object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45 0 (7): 0 9022--9040, 2023 c
2023
-
[53]
Cliff: Continual latent diffusion for open-vocabulary object detection
Wuyang Li, Xinyu Liu, Jiayi Ma, and Yixuan Yuan. Cliff: Continual latent diffusion for open-vocabulary object detection. In European Conference on Computer Vision, pages 255--273. Springer, 2024 d
2024
-
[54]
From static to dynamic diagnostics: Boosting medical image analysis via motion-informed generative videos
Wuyang Li, Xinyu Liu, Qiushi Yang, and Yixuan Yuan. From static to dynamic diagnostics: Boosting medical image analysis via motion-informed generative videos. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 195--205. Springer, 2024 e
2024
-
[55]
Voxdet: Rethinking 3d semantic occupancy prediction as dense object detection
Wuyang Li, Zhu Yu, and Alexandre Alahi. Voxdet: Rethinking 3d semantic occupancy prediction as dense object detection. arXiv preprint arXiv:2506.04623, 2025
2025 arXiv
-
[56]
Swinir: Image restoration using swin transformer
Jingyun Liang, Jiezhang Cao, Guolei Sun, Kai Zhang, Luc Van Gool, and Radu Timofte. Swinir: Image restoration using swin transformer. In Proceedings of the IEEE/CVF international conference on computer vision, pages 1833--1844, 2021
2021
-
[57]
Achromatic metalens array for full-colour light-field imaging
Ren Jie Lin, Vin-Cent Su, Shuming Wang, Mu Ku Chen, Tsung Lin Chung, Yu Han Chen, Hsin Yu Kuo, Jia-Wern Chen, Ji Chen, Yi-Teng Huang, et al. Achromatic metalens array for full-colour light-field imaging. Nature nanotechnology, 14 0 (3): 0 227--231, 2019
2019
-
[58]
Diffbir: Towards blind image restoration with generative diffusion prior
Xinqi Lin, Jingwen He, Ziyan Chen, Zhaoyang Lyu, Bo Dai, Fanghua Yu, Wanli Ouyang, Yu Qiao, and Chao Dong. Diffbir: Towards blind image restoration with generative diffusion prior. arXiv preprint arXiv:2308.15070, 2023
2023 arXiv
-
[59]
Rethinking boundary detection in deep learning-based medical image segmentation
Yi Lin, Dong Zhang, Xiao Fang, Yufan Chen, Kwang-Ting Cheng, and Hao Chen. Rethinking boundary detection in deep learning-based medical image segmentation. Medical Image Analysis, page 103615, 2025
2025
-
[60]
Lgs: A light-weight 4d gaussian splatting for efficient surgical scene reconstruction
Hengyu Liu, Yifan Liu, Chenxin Li, Wuyang Li, and Yixuan Yuan. Lgs: A light-weight 4d gaussian splatting for efficient surgical scene reconstruction. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 660--670. Springer, 2024 a
2024
-
[61]
Polyp-gen: Realistic and diverse polyp image generation for endoscopic dataset expansion
Shengyuan Liu, Zhen Chen, Qiushi Yang, Weihao Yu, Di Dong, Jiancong Hu, and Yixuan Yuan. Polyp-gen: Realistic and diverse polyp image generation for endoscopic dataset expansion. arXiv preprint arXiv:2501.16679, 2025 a
2025
-
[62]
A comprehensive evaluation of multi-modal large language models for endoscopy analysis
Shengyuan Liu, Boyun Zheng, Wenting Chen, Zhihao Peng, Zhenfei Yin, Jing Shao, Jiancong Hu, and Yixuan Yuan. A comprehensive evaluation of multi-modal large language models for endoscopy analysis. arXiv preprint arXiv:2505.23601, 2025 b
2025
-
[63]
A rotation-invariant texture vit for fine-grained recognition of esophageal cancer endoscopic ultrasound images
Tianyi Liu, Shuaishuai Zhuang, Jiacheng Nie, Geng Chen, Yusheng Guo, Guangquan Zhou, Jean-Louis Coatrieux, and Yang Chen. A rotation-invariant texture vit for fine-grained recognition of esophageal cancer endoscopic ultrasound images. In European Conference on Computer Vision,...
2025
-
[64]
Intervention & interaction federated abnormality detection with noisy clients
Xinyu Liu, Wuyang Li, and Yixuan Yuan. Intervention & interaction federated abnormality detection with noisy clients. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 309--319. Springer, 2022
2022
-
[65]
Underwater binocular meta-lens
Xiaoyuan Liu, Mu Ku Chen, Cheng Hung Chu, Jingcheng Zhang, Borui Leng, Takeshi Yamaguchi, Takuo Tanaka, and Din Ping Tsai. Underwater binocular meta-lens. ACS Photonics, 10 0 (7): 0 2382--2389, 2023 a
2023
-
[66]
Decoupled unbiased teacher for source-free domain adaptive medical object detection
Xinyu Liu, Wuyang Li, and Yixuan Yuan. Decoupled unbiased teacher for source-free domain adaptive medical object detection. IEEE Transactions on Neural Networks and Learning Systems, 35 0 (6): 0 7287--7298, 2023 b
2023
-
[67]
Stereo vision meta-lens-assisted driving vision
Xiaoyuan Liu, Wuyang Li, Takeshi Yamaguchi, Zihan Geng, Takuo Tanaka, Din Ping Tsai, and Mu Ku Chen. Stereo vision meta-lens-assisted driving vision. ACS Photonics, 11 0 (7): 0 2546--2555, 2024 b
2024
-
[68]
Diffrect: Latent diffusion label rectification for semi-supervised medical image segmentation
Xinyu Liu, Wuyang Li, and Yixuan Yuan. Diffrect: Latent diffusion label rectification for semi-supervised medical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 56--66. Springer, 2024 c
2024
-
[69]
Meta-lens particle image velocimetry
Xiaoyuan Liu, Zhou Zhao, Shengming Xu, Jingcheng Zhang, Yin Zhou, Yulun He, Takeshi Yamaguchi, Hua Ouyang, Takuo Tanaka, Mu Ku Chen, et al. Meta-lens particle image velocimetry. Advanced Materials, 36 0 (17): 0 2310134, 2024 d
2024
-
[70]
Rolling-unet: Revitalizing mlp’s ability to efficiently extract long-distance dependencies for medical image segmentation
Yutong Liu, Haijiang Zhu, Mengting Liu, Huaiyuan Yu, Zihan Chen, and Jie Gao. Rolling-unet: Revitalizing mlp’s ability to efficiently extract long-distance dependencies for medical image segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 3819...
2024
-
[71]
Dc-unet: rethinking the u-net architecture with dual channel efficient cnn for medical image segmentation
Ange Lou, Shuyue Guan, and Murray Loew. Dc-unet: rethinking the u-net architecture with dual channel efficient cnn for medical image segmentation. In Medical Imaging 2021: Image Processing, pages 758--768, 2021
2021
-
[72]
Varifocal metalens for optical sectioning fluorescence microscopy
Yuan Luo, Cheng Hung Chu, Sunil Vyas, Hsin Yu Kuo, Yu Hsin Chia, Mu Ku Chen, Xu Shi, Takuo Tanaka, Hiroaki Misawa, Yi-You Huang, et al. Varifocal metalens for optical sectioning fluorescence microscopy. Nano Letters, 21 0 (12): 0 5133--5142, 2021
2021
-
[73]
Llm-guided decoupled probabilistic prompt for continual learning in medical image diagnosis
Yiwen Luo, Wuyang Li, Cheng Chen, Xiang Li, Tianming Liu, Tianye Niu, and Yixuan Yuan. Llm-guided decoupled probabilistic prompt for continual learning in medical image diagnosis. IEEE Transactions on Medical Imaging, 2025
2025
-
[74]
U-mamba: Enhancing long-range dependency for biomedical image segmentation
Jun Ma, Feifei Li, and Bo Wang. U-mamba: Enhancing long-range dependency for biomedical image segmentation. arXiv preprint arXiv:2401.04722, 2024
2024 arXiv
-
[75]
Shape-guided configuration-aware learning for endoscopic-image-based pose estimation of flexible robotic instruments
Yiyao Ma, Kai Chen, Hon-Sing Tong, Ruofeng Wei, Yui-Lun Ng, Ka-Wai Kwok, and Qi Dou. Shape-guided configuration-aware learning for endoscopic-image-based pose estimation of flexible robotic instruments. In European Conference on Computer Vision, pages 259--276. Springer, 2025
2025
-
[76]
Real-time hyperspectral imaging in hardware via trained metasurface encoders
Maksim Makarenko, Arturo Burguete-Lopez, Qizhou Wang, Fedor Getman, Silvio Giancola, Bernard Ghanem, and Andrea Fratalocchi. Real-time hyperspectral imaging in hardware via trained metasurface encoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern R...
2022
-
[77]
Hardware-accelerated integrated optoelectronic platform towards real-time high-resolution hyperspectral video understanding
Maksim Makarenko, Arturo Burguete-Lopez, Qizhou Wang, Silvio Giancola, Bernard Ghanem, Luca Passone, and Andrea Fratalocchi. Hardware-accelerated integrated optoelectronic platform towards real-time high-resolution hyperspectral video understanding. Nature Communications, 15 0...
2024
-
[78]
Mixture of experts: a literature survey
Saeed Masoudnia and Reza Ebrahimpour. Mixture of experts: a literature survey. Artificial Intelligence Review, 42: 0 275--293, 2014
2014
-
[79]
Artificial intelligence and upper gastrointestinal endoscopy: Current status and future perspective
Yuichi Mori, Shin-ei Kudo, Hussein EN Mohmed, Masashi Misawa, Noriyuki Ogata, Hayato Itoh, Masahiro Oda, and Kensaku Mori. Artificial intelligence and upper gastrointestinal endoscopy: Current status and future perspective. Digestive endoscopy, 31 0 (4): 0 378--388, 2019
2019
-
[80]
Artificial intelligence in endoscopy
Yutaka Okagawa, Seiichiro Abe, Masayoshi Yamada, Ichiro Oda, and Yutaka Saito. Artificial intelligence in endoscopy. Digestive Diseases and Sciences, 67 0 (5): 0 1553--1572, 2022
2022
-
[81]
Attention u-net: Learning where to look for the pancreas
Ozan Oktay, Jo Schlemper, Loic Le Folgoc, Matthew Lee, Mattias Heinrich, Kazunari Misawa, Kensaku Mori, Steven McDonagh, Nils Y Hammerla, Bernhard Kainz, et al. Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999, 2018
2018 arXiv
-
[82]
Dinov2: Learning robust visual features without supervision
Maxime Oquab, Timoth \'e e Darcet, Th \'e o Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023
2023 arXiv
-
[83]
Semi-supervised semantic segmentation meets masked modeling: Fine-grained locality learning matters in consistency regularization
Wentao Pan, Zhe Xu, Jiangpeng Yan, Zihan Wu, Raymond Kai-yu Tong, Xiu Li, and Jianhua Yao. Semi-supervised semantic segmentation meets masked modeling: Fine-grained locality learning matters in consistency regularization. arXiv preprint arXiv:2312.08631, 2023 a
2023 arXiv
-
[84]
Human-machine interactive tissue prototype learning for label-efficient histopathology image segmentation
Wentao Pan, Jiangpeng Yan, Hanbo Chen, Jiawei Yang, Zhe Xu, Xiu Li, and Jianhua Yao. Human-machine interactive tissue prototype learning for label-efficient histopathology image segmentation. In International Conference on Information Processing in Medical Imaging, pages 679--...
2023
-
[85]
Leveraging near-field lighting for monocular depth estimation from endoscopy videos
Akshay Paruchuri, Samuel Ehrenstein, Shuxian Wang, Inbar Fried, Stephen M Pizer, Marc Niethammer, and Roni Sengupta. Leveraging near-field lighting for monocular depth estimation from endoscopy videos. In European Conference on Computer Vision. Springer, 2025
2025
-
[86]
Fresnel diffraction and the fractional-order fourier transform
Pierre Pellat-Finet. Fresnel diffraction and the fractional-order fourier transform. Optics Letters, 19 0 (18): 0 1388--1390, 1994
1994
-
[87]
High-efficiency, large-area, topology-optimized metasurfaces
Thaibao Phan, David Sell, Evan W Wang, Sage Doshay, Kofi Edee, Jianji Yang, and Jonathan A Fan. High-efficiency, large-area, topology-optimized metasurfaces. Light: Science & Applications, 8 0 (1): 0 48, 2019
2019
-
[88]
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention--MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part...
2015
-
[89]
Deep-learning-driven end-to-end metalens imaging
Joonhyuk Seo, Jaegang Jo, Joohoon Kim, Joonho Kang, Chanik Kang, Seongwon Moon, Eunji Lee, Jehyeong Hong, Junsuk Rho, and Haejun Chung. Deep-learning-driven end-to-end metalens imaging. arXiv preprint arXiv:2312.02669, 2023
2023 arXiv
-
[90]
Procedure-aware surgical video-language pretraining with hierarchical knowledge augmentation
Vinkle Srivastav, Nassir Navab, Nicolas Padoy, et al. Procedure-aware surgical video-language pretraining with hierarchical knowledge augmentation. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024
2024
-
[91]
Neural nano-optics for high-quality thin lens imaging
Ethan Tseng, Shane Colburn, James Whitehead, Luocheng Huang, Seung-Hwan Baek, Arka Majumdar, and Felix Heide. Neural nano-optics for high-quality thin lens imaging. Nature communications, 12 0 (1): 0 6493, 2021
2021
-
[92]
Metalenses: advances and applications
Ming Lun Tseng, Hui-Hsin Hsiao, Cheng Hung Chu, Mu Ku Chen, Greg Sun, Ai-Qun Liu, and Din Ping Tsai. Metalenses: advances and applications. Advanced Optical Materials, 6 0 (18): 0 1800554, 2018
2018
-
[93]
Ai for optical metasurface
Akira Ueno, Juejun Hu, and Sensong An. Ai for optical metasurface. npj Nanophotonics, 1 0 (1): 0 36, 2024
2024
-
[94]
Unext: Mlp-based rapid medical image segmentation network
Jeya Maria Jose Valanarasu and Vishal M Patel. Unext: Mlp-based rapid medical image segmentation network. In International conference on medical image computing and computer-assisted intervention, pages 23--33. Springer, 2022
2022
-
[95]
Dense u-net based on patch-based learning for retinal vessel segmentation
Chang Wang, Zongya Zhao, Qiongqiong Ren, Yongtao Xu, and Yi Yu. Dense u-net based on patch-based learning for retinal vessel segmentation. Entropy, 21 0 (2): 0 168, 2019
2019
-
[96]
A broadband achromatic metalens in the visible
Shuming Wang, Pin Chieh Wu, Vin-Cent Su, Yi-Chieh Lai, Mu-Ku Chen, Hsin Yu Kuo, Bo Han Chen, Yu Han Chen, Tzu-Ting Huang, Jung-Hsi Wang, et al. A broadband achromatic metalens in the visible. Nature nanotechnology, 13 0 (3): 0 227--232, 2018
2018
-
[97]
Robust freeform metasurface design based on progressively growing generative networks
Fufang Wen, Jiaqi Jiang, and Jonathan A Fan. Robust freeform metasurface design based on progressively growing generative networks. Acs Photonics, 7 0 (8): 0 2098--2104, 2020
2020
-
[98]
Medical sam adapter: Adapting segment anything model for medical image segmentation
Junde Wu, Wei Ji, Yuanpei Liu, Huazhu Fu, Min Xu, Yanwu Xu, and Yueming Jin. Medical sam adapter: Adapting segment anything model for medical image segmentation. arXiv preprint arXiv:2304.12620, 2023
2023 arXiv
-
[99]
Self-supervised video desmoking for laparoscopic surgery
Renlong Wu, Zhilu Zhang, Shuohao Zhang, Longfei Gou, Haobin Chen, Lei Zhang, Hao Chen, and Wangmeng Zuo. Self-supervised video desmoking for laparoscopic surgery. In European Conference on Computer Vision, pages 307--324. Springer, 2025
2025
-
[100]
Unified perceptual parsing for scene understanding
Tete Xiao, Yingcheng Liu, Bolei Zhou, Yuning Jiang, and Jian Sun. Unified perceptual parsing for scene understanding. In Proceedings of the European conference on computer vision (ECCV), pages 418--434, 2018
2018
-
[101]
Segformer: Simple and efficient design for semantic segmentation with transformers
Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M Alvarez, and Ping Luo. Segformer: Simple and efficient design for semantic segmentation with transformers. In Neural Information Processing Systems (NeurIPS), 2021
2021
-
[102]
Hierarchical attention guided framework for multi-resolution collaborative whole slide image segmentation
Jiangpeng Yan, Hanbo Chen, Kang Wang, Yan Ji, Yuyao Zhu, Jingjing Li, Dong Xie, Zhe Xu, Junzhou Huang, Shuqun Cheng, et al. Hierarchical attention guided framework for multi-resolution collaborative whole slide image segmentation. In International conference on medical image c...
2021
-
[103]
Mrm: Masked relation modeling for medical image pre-training with genetics
Qiushi Yang, Wuyang Li, Baopu Li, and Yixuan Yuan. Mrm: Masked relation modeling for medical image pre-training with genetics. In Proceedings of the IEEE/CVF international conference on computer vision, pages 21452--21462, 2023
2023
-
[104]
Embedding-free transformer with inference spatial reduction for efficient semantic segmentation
Hyunwoo Yu, Yubin Cho, Beoungwoo Kang, Seunghun Moon, Kyeongbo Kong, and Suk-Ju Kang. Embedding-free transformer with inference spatial reduction for efficient semantic segmentation. In European Conference on Computer Vision, pages 92--110, 2025
2025
-
[105]
Restormer: Efficient transformer for high-resolution image restoration
Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, and Ming-Hsuan Yang. Restormer: Efficient transformer for high-resolution image restoration. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5728--5739, 2022
2022
-
[106]
Ecsnn: Spiking neural networks for efficient exposure correction in endoscopy imaging
Jun Zhang, Zhuoran Zheng, Jingang Zhang, and Wenqi Ren. Ecsnn: Spiking neural networks for efficient exposure correction in endoscopy imaging. In ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1--5. IEEE, 2025
2025
-
[107]
Deep learning to accelerate scatterer-to-field mapping for inverse design of dielectric metasurfaces
Maksym V Zhelyeznyakov, Steve Brunton, and Arka Majumdar. Deep learning to accelerate scatterer-to-field mapping for inverse design of dielectric metasurfaces. ACS Photonics, 8 0 (2): 0 481--488, 2021
2021
-
[108]
Unet++: A nested u-net architecture for medical image segmentation
Zongwei Zhou, Md Mahfuzur Rahman Siddiquee, Nima Tajbakhsh, and Jianming Liang. Unet++: A nested u-net architecture for medical image segmentation. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLM...
2018
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.