REVIEW 3 major objections 5 minor 38 references
UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs
T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper proposes UNSURF, a surface-placement uncertainty measure based on the squared discrepancy between predicted and fitted signed distance functions, and reports that it tracks thickness errors, enables multi-level quality control…
desk verdict UNSURF is a simple, sensible uncertainty measure with solid correlation evidence, but the QC and downstream-AD claims lack the baseline controls needed to back them up. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The object that carries the argument is the signed distance function (SDF), the map from every voxel to its signed distance from a cortical surface, and the fitted-surface SDF $\tilde{D}$ computed after the geometry-processing stage. The UNSURF measure is the squared difference between the network's raw SDF prediction $\hat{D}$ and the SDF of the topologically corrected, deformed surface $\tilde{D}$. Large discrepancies mark voxels where the network's implicit surface disagrees with the final explicit mesh, indicating regions where more than one surface placement is plausible after geometry constraints are enforced.
What would settle it
Take a set of clinical scans for which expert raters manually mark where the reconstructed white-matter or pial surface is misplaced, and compute UNSURF maps on the same scans: if voxels or mesh nodes with the largest $(\hat{D}-\tilde{D})^2$ do not preferentially coincide with the expert-marked misplacements, the measure is not tracking surface placement error. Alternatively, substitute manually edited surfaces for the FreeSurfer-based ground truth in the thickness-error correlation and check whether the reported correlations survive.
Extended reading notes
Core claim
On the paper's own terms, the central discovery is that uncertainty in cortical surface placement should be measured after the geometry step, not before it. Given predicted signed distance functions $\hat{D}^v_i$ from a neural network and signed distance functions $\tilde{D}^v_i$ computed from the surfaces extracted by topological correction and mesh deformation, the voxel-wise squared discrepancy $U_i^v = (\hat{D}^v_i - \tilde{D}^v_i)^2$ acts as a surface-placement uncertainty estimate. Across the evaluated clinical and downsampled scans, $U$ shows positive Spearman and Pearson correlations with thickness error, whereas ensemble-dropout variance of the predicted SDFs is weakly or even negatively correlated with the same errors. Filtering out high-$U$ parcels and nodes reduces thickness errors, and removing high-$U$ subjects increases the Cohen's d effect size separating Alzheimer's patients from controls.
Load-bearing premise
The load-bearing premise is that thickness error computed against FreeSurfer-derived surfaces from high-resolution scans is a valid proxy for true surface placement error in clinical scans, and that the geometry-processing stage is deterministic, so the measured discrepancy reflects only model and data ambiguity rather than algorithmic variability.
Editorial extensions
If this is right
- Automated quality control of cortical surface reconstructions can be performed at the subject, parcel, and mesh-node level on clinical scans without manual review.
- Removing high-uncertainty parcels lowers parcel-level cortical thickness error in the evaluated clinical scans.
- Node-level filtering within already uncertain parcels further reduces thickness errors relative to parcel-level filtering alone.
- Uncertainty-based subject filtering increases the effect size of cortical thickness differences between Alzheimer's and control groups.
- Ensemble-dropout variance of predicted SDFs is not a reliable proxy for cortical surface placement uncertainty and should not be used for this purpose.
Reading between the lines
- UNSURF could be computed in any implicit-surface reconstruction pipeline that has a deterministic post-processing step, not just cortical surfaces; the same squared-discrepancy logic may transfer to other anatomical structures whose surfaces are extracted from predicted distance maps.
- Because UNSURF requires no extra network passes at test time, it is cheaper than ensemble dropout or deep ensembles, so a natural next experiment is to measure the computational cost difference directly on the same geometry pipeline.
- The lower correlation at 2 mm and 3 mm slice spacings suggests the measure's practical value is highest for heavily downsampled clinical acquisitions; testing UNSURF on near-isotropic but artifact-heavy scans would delimit this boundary.
- If post-processing were made stochastic, for example by randomizing mesh initialization or deformation steps, part of the discrepancy $U$ would capture algorithmic variability rather than data ambiguity, so separating those two sources would clarify what $U$ actually means.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces UNSURF, a per-voxel uncertainty measure for learning-based cortical surface reconstruction, defined as the squared difference between the signed distance function (SDF) predicted by a CNN and the SDF recomputed from the geometrically processed surface mesh. The measure is aggregated to node, parcel, and subject levels and compared with ensemble-dropout variance on two clinical-style datasets. The authors report correlations between UNSURF and thickness errors (with FreeSurfer-derived surfaces as ground truth), show that filtering high-uncertainty parcels/nodes reduces thickness errors, and report that subject-level filtering increases Cohen's d in an AD versus CN classification analysis.
Significance. If the claims are substantiated, UNSURF would be a valuable and low-cost uncertainty signal: it requires no additional training, it is deterministic, and it explicitly reflects the geometric corrections that variance-based measures miss. The paper's strengths are the use of real heterogeneous clinical data, the head-to-head comparison with ensemble dropout variance, and the multi-level aggregation scheme. I also agree that UNSURF is not circular in a parameter-fitting sense; it is an internal consistency measure between the raw network output and the final surface. The main gaps are statistical: the filtering experiments lack random baselines and confidence intervals, and the correlation evidence is reported without uncertainty bounds, so the central QC and downstream-benefit claims are not yet fully supported.
major comments (3)
- [Section 3.3, Figure 3(d)-(e); Section 3.4, Figure 4] The QC and downstream-benefit claims are not supported by the reported filtering experiments because there is no baseline that removes the same fraction of data at random, or according to an independent quality measure. Any selection rule correlated with thickness error will mechanically reduce mean error as data are removed, and Cohen's d computed on shrinking subsamples is biased and increasingly noisy. Please add random-filtering control curves with confidence intervals (for example, repeated random subsampling at each kept fraction), and report the number of subjects and the AD/CN group sizes retained at each point in Figure 4.
- [Section 3.4, Figure 4] Subject-level filtering by U^s may change the AD/CN composition of the sample: if high-uncertainty subjects are disproportionately from one diagnostic group, the effect-size increase may reflect altered group balance rather than improved measurement quality. The paper should report the AD/CN counts and the age/gender distributions after each filtering step, and should ideally demonstrate that the effect-size trend persists after adjusting for these factors, or when using within-subject parcel- or node-level filtering only.
- [Section 3.2, Figure 2; Section 3.3, Figure 3(a)-(c)] The central correlation evidence lacks uncertainty quantification: SCC/PCC values are presented without confidence intervals, p-values, or correction for the large number of parcels in Figure 3(a). Moreover, the ground-truth thickness errors are computed against FreeSurfer surfaces derived from 1 mm T1 scans, which are themselves an imperfect proxy for true surface placement error; this should be explicitly acknowledged and ideally bounded by a repeatability or inter-method analysis. Without these, it is difficult to judge whether the reported differences between variance and UNSURF are statistically meaningful.
minor comments (5)
- [Figure 2 caption] The text says "Person correlation coefficient" but the standard term is "Pearson correlation coefficient."
- [Section 2.1] The word "wihtout" should be "without" in the sentence describing the Euler characteristic.
- [Section 3.3, Figure 3 caption] The caption says "At 100, all subjects are kept" but the filtering in panels (d) and (e) is applied to parcels and nodes; please clarify the exact denominator and the data unit being kept in each panel.
- [Section 2.2] The proposed measure is called "uncertainty" but is defined as a deterministic discrepancy; the paper would benefit from a brief discussion of what sources of error this discrepancy captures (geometric correction, smoothing, topological changes) and what it cannot capture (systematic bias shared by the prediction and the geometry-processing step).
- [Section 3.4, Figure 4] The red dashed line for Recon-All is not clearly defined; please specify whether this is FreeSurfer applied to the original 1 mm T1 or to a native low-resolution scan, and how the mean effect size is computed across parcels.
Circularity Check
No significant circularity: UNSURF is an independent discrepancy measure empirically correlated with thickness error; the only self-citation is a non-load-bearing component citation.
full rationale
UNSURF is defined as U_v^i = (Dhat_v^i - Dtilde_v^i)^2, a deterministic discrepancy between the network-predicted SDF and the SDF of the final geometrically processed surface. Thickness errors are computed separately as differences between reconstructed thickness and FreeSurfer-derived ground-truth thickness. No equation in the paper derives thickness error from U, nor is U fitted to thickness errors; the reported correlations are empirical findings, not reductions by construction. The fact that the SDF predictor is trained on FreeSurfer targets may explain why U tracks proximity to FreeSurfer geometry, but this is a mechanistic explanation, not a logical circularity. The QC and downstream filtering experiments (Figs. 3d/e and 4) lack random-filtering baselines, confidence intervals, and p-values, which weakens the statistical support for those claims, but this is a validity/statistical concern rather than a circular derivation. Self-citations to recon-all-clinical [14,15] and to SynthSR/SynthSeg [4,21] are component and prior-work citations; UNSURF itself is evaluated against independent held-out clinical data with FreeSurfer ground truth, so these citations are not load-bearing for the central UNSURF claim. The score of 2 reflects one minor non-load-bearing self-citation, not an actual circular step.
Assumptions & free parameters
assumptions (2)
- domain assumption The synthetic data generation pipeline (domain randomization) produces scans diverse enough to make the model generalize to clinical data.
- domain assumption FreeSurfer reconstructions on 1mm T1 scans are a valid ground truth for cortical surfaces in this evaluation.
Cite this review
Pith. "Pith review of UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs." pith.science (2026). https://pith.science/paper/EFCJBF73
@misc{pith2026250600498,
author = {Pith},
title = {Pith review of: UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs},
year = {2026},
howpublished = {\url{https://pith.science/paper/EFCJBF73}},
note = {Machine review of arXiv:2506.00498}
}
read the original abstract
We propose UNSURF, a novel uncertainty measure for cortical surface reconstruction of clinical brain MRI scans of any orientation, resolution, and contrast. It relies on the discrepancy between predicted voxel-wise signed distance functions (SDFs) and the actual SDFs of the fitted surfaces. Our experiments on real clinical scans show that traditional uncertainty measures, such as voxel-wise Monte Carlo variance, are not suitable for modeling the uncertainty of surface placement. Our results demonstrate that UNSURF estimates correlate well with the ground truth errors and: \textit{(i)}~enable effective automated quality control of surface reconstructions at the subject-, parcel-, mesh node-level; and \textit{(ii)}~improve performance on a downstream Alzheimer's disease classification task.
Figures
Figures from the paper (1 more)
Reference graph
Works this paper leans on
-
[1]
Ashukha, A., Lyzhov, A., Molchanov, D., Vetrov, D.: Pitfalls of in-domain uncer- tainty estimation and ensembling in deep learning. ICLR (2020)
work page 2020
-
[2]
NeurIPS Benchmarking track (2022) 10 Mehta and Gopinath et al
Band, N., Rudner, T.G., Feng, Q., Filos, A., Nado, Z., Dusenberry, M.W., Jerfel, G.,Tran,D.,Gal,Y.:Benchmarkingbayesiandeeplearningondiabeticretinopathy detection tasks. NeurIPS Benchmarking track (2022) 10 Mehta and Gopinath et al
work page 2022
-
[3]
Baumgartner, C.F., Tezcan, K.C., Chaitanya, K., Hötker, A.M., Muehlematter, U.J., Schawkat, K., Becker, A.S., Donati, O., Konukoglu, E.: Phiseg: Capturing uncertainty in medical image segmentation. In: MICCAI. pp. 119–127 (2019)
work page 2019
-
[4]
Medical image analysis86 (2023)
Billot, B., Greve, D.N., Puonti, O., Thielscher, A., Van Leemput, K., Fischl, B., Dalca, A.V., Iglesias, J.E., et al.: Synthseg: Segmentation of brain mri scans of any contrast and resolution without retraining. Medical image analysis86 (2023)
work page 2023
- [5]
- [6]
-
[7]
Medical image analysis 57, 226–236 (2019)
Dalca, A.V., Balakrishnan, G., Guttag, J., Sabuncu, M.R.: Unsupervised learning of probabilistic diffeomorphic registration for images and surfaces. Medical image analysis 57, 226–236 (2019)
work page 2019
-
[8]
Durso-Finley, J., Falet, J.P., Mehta, R., Arnold, D.L., Pawlowski, N., Arbel, T.: Improving image-based precision medicine with uncertainty-aware causal models. In: MICCAI. pp. 472–481. Springer (2023)
work page 2023
Show all 38 references
-
[9]
Neuroimage9(2), 195–207 (1999)
Fischl,B.,Sereno,M.,Dale,A.M.:Corticalsurface-basedanalysis:II:inflation,flat- tening, and a surface-based coordinate system. Neuroimage9(2), 195–207 (1999)
1999
-
[10]
In: Medical Imaging with Deep Learning (2021)
Fuchs, M., Gonzalez, C., Mukhopadhyay, A.: Practical uncertainty quantification for brain tumor segmentation. In: Medical Imaging with Deep Learning (2021)
2021
-
[11]
In: ICML
Gal, Y., Ghahramani, Z.: Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In: ICML. pp. 1050–1059 (2016)
2016
-
[12]
Neuroimage80, 105–24 (2013)
Glasser, M., Sotiropoulos, S., Wilson, J.A., Coalson, T.S.: The minimal preprocess- ing pipelines for the Human Connectome Project. Neuroimage80, 105–24 (2013)
2013
-
[13]
In: MICCAI
Gopinath, K., Desrosiers, C., Lombaert, H.: SegRecon: Learning joint brain surface reconstruction and segmentation from images. In: MICCAI. pp. 650–659 (2021)
2021
-
[14]
In: MICCAI
Gopinath, K., Greve, D.N., Das, S., Arnold, S., Magdamo, C., Iglesias, J.E.: Corti- cal analysis of heterogeneous clinical brain mri scans for large-scale neuroimaging studies. In: MICCAI. pp. 35–45. Springer (2023)
2023
-
[15]
arXiv preprint arXiv:2409.03889 (2024)
Gopinath, K., Greve, D.N., Magdamo, C., Arnold, S., Das, S., Puonti, O., Iglesias, J.E.: Recon-all-clinical: Cortical surface reconstruction and analysis of heteroge- neous clinical brain mri. arXiv preprint arXiv:2409.03889 (2024)
2024 arXiv
-
[16]
Imaging Neuroscience2, 1–22 (2024)
Gopinath, K., Hoopes, A., et al.: Synthetic data in generalizable, learning-based neuroimaging. Imaging Neuroscience2, 1–22 (2024)
2024
-
[17]
NeuroImage251, 118933 (2022)
Henschel, L., Kügler, D., Reuter, M.: Fastsurfervinn: Building resolution- independence into deep learning segmentation methods—a solution for highres brain mri. NeuroImage251, 118933 (2022)
2022
-
[18]
Proceedings of machine learning research 172, 508 (2022)
Hoopes, A., Iglesias, J.E., Fischl, B., Greve, D., Dalca, A.V.: Topofit: rapid recon- struction of topologically-correct cortical surfaces. Proceedings of machine learning research 172, 508 (2022)
2022
-
[19]
ICLR (2025)
Hu, X., Gopinath, K., Liu, P., et al.: Hierarchical uncertainty estimation for learning-based registration in neuroimaging. ICLR (2025)
2025
-
[20]
Medical Image Analysis p
Huang, L., Ruan, S., Xing, Y., Feng, M.: A review of uncertainty quantification in medical image analysis: Probabilistic and non-probabilistic methods. Medical Image Analysis p. 103223 (2024)
2024
-
[21]
Science advances9(5), eadd3607 (2023) UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction 11
Iglesias, J.E., Billot, B., Balbastre, Y., Magdamo, C., Arnold, et al.: SynthSR: A public AI tool to turn heterogeneous clinical brain scans into high-resolution T1-weighted images for 3D morphometry. Science advances9(5), eadd3607 (2023) UNSURF: Uncertainty Quantification for...
2023
-
[22]
Journal of Magnetic Res- onance Imaging 27(4), 685–691 (2008)
Jack Jr, C.R., Bernstein, M.A., Fox, N.C., Thompson, P., et al.: The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. Journal of Magnetic Res- onance Imaging 27(4), 685–691 (2008)
2008
-
[23]
In: NeurIPS
Lakshminarayanan, B., Pritzel, A., Blundell, C.: Simple and scalable predictive uncertainty estimation using deep ensembles. In: NeurIPS. vol. 30 (2017)
2017
-
[24]
IEEE Transactions on Medical Imaging 42(2), 430–443 (2022)
Ma, Q., Li, L., Robinson, E.C., Kainz, B., Rueckert, D., Alansary, A.: CortexODE: Learning cortical surface reconstruction by neural ODEs. IEEE Transactions on Medical Imaging 42(2), 430–443 (2022)
2022
-
[25]
The MELBA journal2022 (2022)
Mehta, R., Filos, A., et al.: Qu-brats: Miccai brats 2020 challenge on quantifying uncertainty in brain tumor segmentation-analysis of ranking scores and bench- marking results. The MELBA journal2022 (2022)
2022
-
[26]
IEEE TMI41(2), 360–373 (2021)
Mehta, R., et al.: Propagating uncertainty across cascaded medical imaging tasks for improved deep learning inference. IEEE TMI41(2), 360–373 (2021)
2021
-
[27]
Medical image analysis 59, 101557 (2020)
Nair, T., Precup, D., Arnold, D.L., Arbel, T.: Exploring uncertainty measures in deep networks for multiple sclerosis lesion detection and segmentation. Medical image analysis 59, 101557 (2020)
2020
-
[28]
Neal, R.M.: Bayesian learning for neural networks, vol. 118. Springer Science & Business Media (2012)
2012
-
[29]
NeuroImage143 (2016)
Puonti, O., Iglesias, J.E., Van Leemput, K.: Fast and sequence-adaptive whole- brain segmentation using parametric bayesian modeling. NeuroImage143 (2016)
2016
-
[30]
In: MICCAI
Ren, K., Zou, K., Liu, X., Chen, Y., Yuan, X., Shen, X., Wang, M., Fu, H.: Uncertainty-informed mutual learning for joint medical image classification and segmentation. In: MICCAI. pp. 35–45. Springer (2023)
2023
-
[31]
In: MICCAI
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomed- ical image segmentation. In: MICCAI. pp. 234–241 (2015)
2015
-
[32]
Cerebral cortex 14(7), 721–730 (2004)
Salat, D.H., Buckner, R.L., Snyder, A.Z., Greve, D.N., Desikan, R.S., Busa, E., Morris, J.C., Dale, A.M., Fischl, B.: Thinning of the cerebral cortex in aging. Cerebral cortex 14(7), 721–730 (2004)
2004
-
[33]
Medical image analysis6(2), 129–142 (2002)
Shattuck, D.W., Leahy, R.M.: Brainsuite: an automated cortical surface identifi- cation tool. Medical image analysis6(2), 129–142 (2002)
2002
-
[34]
arXiv preprint arXiv:1803.08533 (2018)
Smith, L., Gal, Y.: Understanding measures of uncertainty for adversarial example detection. arXiv preprint arXiv:1803.08533 (2018)
2018 arXiv
-
[35]
NeuroImage 225 (2020)
Tanno, R., Worrall, D.E., Kaden, E., Alexander, D.C.: Uncertainty modelling in deep learning for safer neuroimage enhancement: Demonstration in diffusion mri. NeuroImage 225 (2020)
2020
-
[36]
IEEE Transactions on Medical Imaging41(7), 1885–1896 (2022)
Tezcan, K.C., Karani, N., Baumgartner, C.F., Konukoglu, E.: Sampling possible reconstructions of undersampled acquisitions in mr imaging with a deep learned prior. IEEE Transactions on Medical Imaging41(7), 1885–1896 (2022)
2022
-
[37]
Neurocomputing338, 34–45 (2019)
Wang, G., Li, W., Aertsen, M., Deprest, J., Ourselin, S., Vercauteren, T.: Aleatoric uncertainty estimation with test-time augmentation for medical image segmenta- tion with convolutional neural networks. Neurocomputing338, 34–45 (2019)
2019
-
[38]
NeurIPS36 (2024)
Zheng, H., Li, H., Fan, Y.: Coupled reconstruction of cortical surfaces by diffeo- morphic mesh deformation. NeurIPS36 (2024)
2024
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.