REVIEW 3 major objections 5 minor 37 references
Suppressing Uncertainty in Gaze Estimation
T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read By comparing three labels per image—ground truth, prediction, and neighbor-derived label—SUGE detects unreliable samples, then weights and corrects them, improving gaze estimation.
desk verdict A novel triplet-label consistency method for gaze estimation with small but consistent gains; the neighboring-label construction needs a nonnegativity fix and more rigorous evaluation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The mechanism that carries the argument is the neighboring label, defined as the reconstruction-weighted average of ground-truth labels of the K nearest neighbors of an image in the encoder's feature space, restricted to the same person. It gives each sample a third label that is independent of both the possibly wrong annotation and the model's own prediction. Around this, the paper defines two uncertainty statistics: TupleMD, $\min(D_{pg}, D_{ng})/(D_{pn} + \epsilon)$, which scores label quality by how far the ground-truth label stands from both other labels, and TripleMD, $\min(D_{pg}, D_{pn}, D_{ng})$, which scores image quality by the largest disagreement among any pair of the three labels. A two-component GMM converts these statistics into label and image confidences; sample weighting puts the image confidence into the loss $L = \sum_i \hat{W}_i \|\hat{Y}_i - f(E(X_i))\|_1$, and label correction blends ground-truth, pseudo, neighboring, and flipped labels according to label confidence. A co-training loop lets two networks exchange their corrected labels and weights to avoid overconfidence in self-generated confidences.
What would settle it
Re-annotate a random subset of EyeDiap or Gaze360 training images independently and check whether samples flagged with low label confidence are precisely those whose original labels disagree with the re-annotation, and whether the corrected labels land closer to the re-annotation; if they do not, the triplet-label uncertainty is not measuring real label noise.
Extended reading notes
Core claim
The central claim is that a triplet-label consistency measure can detect which gaze training samples are unreliable and then suppress the damage they cause, without needing a clean external set. For each sample, the method builds a neighboring label $\hat{Y}^n_i = \sum_{j=1}^{K} Y_{ij} A_{ij}$ from reconstruction-weighted ground-truth labels of the sample's K nearest same-person neighbors in the encoder's feature space, and places it alongside the ground-truth label $Y_i$ and the pseudo label $\hat{Y}^p_i$. Two angular statistics, TupleMD and TripleMD, are fed to a two-component Gaussian Mixture Model, producing a label confidence and an image confidence. The label confidence drives label correction (a blend of ground truth, pseudo, neighboring, and horizontally flipped labels), the image confidence drives sample weighting, and two networks co-train with exchanged confidences. Concretely, the method lowers mean angular error on EyeDiap from 5.46° to 5.05° with the Gaze360 backbone and from 5.34° to 5.04° with the GazeTR backbone, and on Gaze360 from 10.78° to 10.52° with the Gaze360 backbone.
Load-bearing premise
The method assumes that images that look similar to the model should have similar gaze directions, so a weighted average of nearby images' labels is a trustworthy reference; if this local smoothness fails, the uncertainty scores, the sample weights, and the corrected labels are all biased.
Editorial extensions
If this is right
- With the Gaze360 backbone, SUGE lowers EyeDiap mean angular error from 5.46° to 5.05° and Gaze360 from 10.78° to 10.52°.
- The same scheme improves the GazeTR transformer backbone on EyeDiap (5.34° to 5.04°) and Gaze360 (10.61° to 10.51°), showing the uncertainty module transfers across architecture families.
- SUGE beats two noisy-label learning methods adapted to gaze regression, CoTeaching and DivideMix, on both EyeDiap and Gaze360 with the Gaze360 backbone.
- Ablations attribute the gain to all designed parts: removing label correction costs 0.12°, removing sample weighting costs 0.05°, removing neighboring labels costs 0.11°, and switching from co-training to self-training costs 0.09°.
Reading between the lines
- The neighboring-label premise could be stress-tested by running SUGE without reducing the feature dimension to 16; if gains shrink when nearest neighbors in high-dimensional space no longer align with label similarity, the local-smoothness assumption is the active ingredient.
- The same triplet-label recipe should transfer to other continuous regression tasks with locally smooth labels, such as head-pose or body-orientation estimation, where noisy annotations and low-quality frames are also common.
- The hard confidence truncation at $\tau = 0.5$ discards partial evidence from moderately uncertain samples; a soft, temperature-scaled weighting might extract more signal from them.
- Because corrected labels are partly built from the model's own pseudo labels, systematic model errors could reinforce annotation errors; co-training reduces but does not remove this risk, so testing with a third independent network is a natural safeguard.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes SUGE, a training-time method for gaze estimation that estimates two kinds of uncertainty: image quality and label correctness. For each training sample, it constructs a "neighboring label" by linearly reconstructing the sample's feature vector from K same-person feature neighbors and applying the same weights to their ground-truth labels. The neighboring label, together with the model's pseudo label and the ground-truth label, defines two uncertainty metrics (TupleMD and TripleMD), which are fed to a bimodal GMM to obtain label and image confidences. These confidences are then used to truncate unreliable samples, correct labels via a weighted combination of ground-truth, pseudo, and neighboring labels, and weight the training loss. Two networks are trained simultaneously in a co-training style, exchanging corrected labels and weights. Experiments on EyeDiap, MPIIFaceGaze, and Gaze360 with Gaze360 and GazeTR backbones report consistent improvements over the authors' re-implemented baselines, plus ablations and parameter sensitivity analyses on EyeDiap.
Significance. If the method is sound, the paper addresses a real and under-explored issue in gaze estimation: training-set contamination by low-quality images and imprecise annotations. The proposed triplet-label consistency is a novel mechanism that could generalize to other regression tasks with similarly structured uncertainty. The manuscript is also usefully concrete: it re-implements two strong baselines, provides ablations that isolate each module, and uses held-out benchmark splits for evaluation, so the empirical claim is not circular. However, the central mechanism relies on an unconstrained linear reconstruction whose interpretation as a "weighted average" of neighbor labels is mathematically incorrect, and the reported gains are small and lack statistical support. These issues affect the paper's main claims and require substantial revision.
major comments (3)
- [Neighboring Labeling Module, Eqs. (1)-(4)] Eq. (1) minimizes ||E(X_i) - sum_j A_ij E(X_ij)||^2 + lambda ||A_i||^2 subject only to sum_j A_ij = 1, with no nonnegativity constraint on A_ij. The closed form in Eq. (2) can therefore contain negative weights, and Yhat^n_i = sum_j Y_ij A_ij in Eq. (4) is not a weighted average or a convex combination; it can extrapolate outside the range of the neighbors' gaze labels. Since TupleMD (Eq. 8) and TripleMD (Eq. 9) measure angular distances to this Yhat^n, the uncertainty metrics no longer measure local agreement with a smooth label manifold whenever a feature vector lies outside the convex hull of its neighbors, which is a generic situation in a 16-dimensional space with K=4. The ablation 'w/o reconstruction weighting' in Table 3 compares only against a plain average, not against a nonnegative-constrained reconstruction, so it does not test whether the reported gains arise from the claimed local-smoothness prior or from a signed extrapolation artifact. The paper should either impose a nonnegativity constraint (e.g., with a simplex projection) and re-run all experiments, or provide empirical statistics on the frequency and magnitude of negative weights and show that the results are insensitive to them.
- [Tables 1-2 and Section 'Comparison with SOTA Gaze Estimation Methods'] The empirical claims are based on single runs without error bars, confidence intervals, or significance tests. The largest reported gain over a re-implemented baseline is 0.41 degrees, but on MPIIFaceGaze SUGE (GazeTR) reports 4.01 vs GazeTR† 4.00, i.e., a slight degradation, and on Gaze360 the GazeTR-based gain is 0.10 degrees. Given the small magnitude of these differences, the phrase 'significantly suggest' in the text is not justified. The authors should report repeated-run statistics (mean and standard deviation over multiple seeds) and, where possible, a paired significance test across the same folds, so that the reader can judge whether the gains are within run-to-run noise.
- [Abstract and Table 1] The abstract and conclusion claim 'state-of-the-art performance,' but Table 1 does not support this claim in a straightforward way: SUGE (GazeTR) does not improve over the original GazeTR on MPIIFaceGaze (4.01 vs 4.00), and the comparison set omits several recent gaze estimation methods that report strong results on these benchmarks. The claim should be narrowed to 'improvements over two re-implemented baselines when SUGE is applied,' or the paper should include a comparison against the current state-of-the-art on the same protocols.
minor comments (5)
- [Eq. (15)] The loss term is written as ||ˆYi - f(E(Xi)||_1; the norm's closing delimiter is missing and the notation is inconsistent with the rest of the paper. Please use a correctly delimited L1 norm.
- [Co-training Strategy and References] The citation '(Friend, Reising, and Cook 1993)' appears to be an education-policy reference on co-teaching, not the machine-learning co-training algorithm; the description in the text (two networks exchanging corrected labels) more closely matches other sources such as Blum and Mitchell (1998) or the co-teaching approach of Han et al. (2018). The authors should replace or supplement the citation appropriately.
- [Implementation Details] The statement 'we reduce the feature dimension to 16 at the final layer of the encoder' is not motivated. Since the neighboring label construction is sensitive to the feature space in which neighbors are found, the choice of 16 should be justified or included in the parameter sensitivity analysis.
- [Eq. (10) and Algorithm 1] The threshold tau is set to 0.5 for both label and image confidence, but the paper does not discuss whether the optimal tau differs between the two quantities or whether the same threshold is appropriate across datasets. A brief discussion of the truncation operation's effect would improve clarity.
- [Visualization Results] Figures 2 and 4 are qualitative; adding quantitative evidence (e.g., the fraction of samples with confidence truncated to zero, or a comparison of corrected versus original labels for a few examples) would strengthen the claim that the uncertainty estimates are meaningful.
Circularity Check
No significant circularity: SUGE is an empirical self-training pipeline whose gains are measured on held-out benchmarks, and no equation reduces to its own inputs.
full rationale
The paper does not claim a first-principles derivation; it proposes an empirical training procedure. The neighboring label in Eq. 4 is a weighted combination of neighbor ground-truth labels using reconstruction weights from Eq. 2; it is then combined with pseudo and ground-truth labels to define uncertainty metrics in Eqs. 8-9. These metrics are fed to a GMM to produce confidences used for sample weighting and label correction in Eqs. 14-15. No equation is defined in terms of the quantity it is supposed to predict, and no fitted parameter is renamed as a prediction. The self-referential use of the model's own pseudo-labels and confidences is a co-training/self-training loop shared with DivideMix, not a circular derivation. Reported improvements are evaluated on held-out test splits of EyeDiap, MPIIFaceGaze, and Gaze360 against re-implemented baselines, so the core claim is externally falsifiable. The only apparent self-citation (Zhou et al. 2023) appears as a related-work pointer and is not load-bearing. The reviewer concern that Eq. 2's reconstruction weights can be negative, making Eq. 4 a signed extrapolation rather than a true convex weighted average, is a correctness or robustness issue about the neighboring-label construction, not a circularity: it does not make the output equivalent to an input by construction. Therefore the appropriate finding is no significant circularity.
Assumptions & free parameters
free parameters (5)
- K (number of neighbors) =
4
- tau_label (label confidence threshold) =
0.5
- tau_image (image confidence threshold) =
0.5
- lambda (reconstruction regularization) =
not reported
- warm-up epochs =
10
assumptions (4)
- domain assumption Gaze labels are locally smooth in the encoder feature space, so a weighted average of the ground-truth labels of K same-person feature neighbors approximates the true label.
- domain assumption The TupleMD and TripleMD values across the training set follow a bimodal Gaussian mixture separating reliable from unreliable samples.
- domain assumption Restricting neighbors to the same person ID is sufficient to avoid identity-related confounds while still providing enough neighbors.
- domain assumption Exchanging corrected labels and weights between two networks prevents overconfidence and cumulative self-training errors.
Cite this review
Pith. "Pith review of Suppressing Uncertainty in Gaze Estimation." pith.science (2026). https://pith.science/paper/XWRP4HVS
@misc{pith2026241212890,
author = {Pith},
title = {Pith review of: Suppressing Uncertainty in Gaze Estimation},
year = {2026},
howpublished = {\url{https://pith.science/paper/XWRP4HVS}},
note = {Machine review of arXiv:2412.12890}
}
read the original abstract
Uncertainty in gaze estimation manifests in two aspects: 1) low-quality images caused by occlusion, blurriness, inconsistent eye movements, or even non-face images; 2) incorrect labels resulting from the misalignment between the labeled and actual gaze points during the annotation process. Allowing these uncertainties to participate in training hinders the improvement of gaze estimation. To tackle these challenges, in this paper, we propose an effective solution, named Suppressing Uncertainty in Gaze Estimation (SUGE), which introduces a novel triplet-label consistency measurement to estimate and reduce the uncertainties. Specifically, for each training sample, we propose to estimate a novel ``neighboring label'' calculated by a linearly weighted projection from the neighbors to capture the similarity relationship between image features and their corresponding labels, which can be incorporated with the predicted pseudo label and ground-truth label for uncertainty estimation. By modeling such triplet-label consistency, we can measure the qualities of both images and labels, and further largely reduce the negative effects of unqualified images and wrong labels through our designed sample weighting and label correction strategies. Experimental results on the gaze estimation benchmarks indicate that our proposed SUGE achieves state-of-the-art performance.
Figures
Reference graph
Works this paper leans on
-
[1]
, " * write output.state after.block = add.period write newline
ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.a...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...
-
[3]
Alberto Funes Mora, K.; and Odobez, J.-M. 2014. Geometric generative gaze estimation (g3e) for remote rgb-d cameras. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1773--1780
work page 2014
-
[4]
Cai, X.; Zeng, J.; Shan, S.; and Chen, X. 2023. Source-Free Adaptive Gaze Estimation by Uncertainty Reduction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 22035--22045
2023
-
[5]
Cheng, Y.; Huang, S.; Wang, F.; Qian, C.; and Lu, F. 2020. A coarse-to-fine adaptive network for appearance-based gaze estimation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, 10623--10630
work page 2020
-
[6]
Cheng, Y.; and Lu, F. 2022. Gaze estimation using transformer. In 2022 26th International Conference on Pattern Recognition (ICPR), 3341--3347. IEEE
work page 2022
-
[7]
Cheng, Y.; Wang, H.; Bao, Y.; and Lu, F. 2021. Appearance-based gaze estimation with deep learning: A review and benchmark. arXiv preprint arXiv:2104.12668
work page Pith review arXiv 2021
-
[8]
A.; Malafronte, D.; Medeiros, H.; and Odone, F
Dias, P. A.; Malafronte, D.; Medeiros, H.; and Odone, F. 2020. Gaze estimation for assisted living environments. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 290--299
work page 2020
Show all 37 references
-
[9]
J.; and Demiris, Y
Fischer, T.; Chang, H. J.; and Demiris, Y. 2018. Rt-gene: Real-time eye gaze estimation in natural environments. In Proceedings of the European conference on computer vision (ECCV), 334--352
2018
-
[10]
Friend, M.; Reising, M.; and Cook, L. 1993. Co-teaching: An overview of the past, a glimpse at the present, and considerations for the future. Preventing School Failure: Alternative Education for Children and Youth, 37(4): 6--10
1993
-
[11]
A.; Monay, F.; and Odobez, J.-M
Funes Mora, K. A.; Monay, F.; and Odobez, J.-M. 2014. Eyediap: A database for the development and evaluation of gaze estimation algorithms from rgb and rgb-d cameras. In Proceedings of the symposium on eye tracking research and applications, 255--258
2014
-
[12]
Han, B.; Yao, Q.; Yu, X.; Niu, G.; Xu, M.; Hu, W.; Tsang, I.; and Sugiyama, M. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems, 31
2018
-
[13]
W.; and Ji, Q
Hansen, D. W.; and Ji, Q. 2009. In the eye of the beholder: A survey of models for eyes and gaze. IEEE transactions on pattern analysis and machine intelligence, 32(3): 478--500
2009
-
[14]
Jiang, M.; and Zhao, Q. 2017. Learning visual attention to identify people with autism spectrum disorder. In Proceedings of the ieee international conference on computer vision, 3267--3276
2017
-
[15]
Kellnhofer, P.; Recasens, A.; Stent, S.; Matusik, W.; and Torralba, A. 2019. Gaze360: Physically unconstrained gaze estimation in the wild. In Proceedings of the IEEE/CVF international conference on computer vision, 6912--6921
2019
-
[16]
Kim, J.; Stengel, M.; Majercik, A.; De Mello, S.; Dunn, D.; Laine, S.; McGuire, M.; and Luebke, D. 2019. Nvgaze: An anatomically-informed dataset for low-latency, near-eye gaze estimation. In Proceedings of the 2019 CHI conference on human factors in computing systems, 1--12
2019
-
[17]
Li, J.; Socher, R.; and Hoi, S. C. 2020. Dividemix: Learning with noisy labels as semi-supervised learning. arXiv preprint arXiv:2002.07394
2020 arXiv
-
[18]
Li, Y.; Han, H.; Shan, S.; and Chen, X. 2023. DISC: Learning from Noisy Labels via Dynamic Instance-Specific Selection and Correction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 24070--24079
2023
-
[19]
Liu, W.; Li, M.; and Yi, L. 2016. Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning framework. Autism Research, 9(8): 888--898
2016
-
[20]
Majaranta, P.; and Bulling, A. 2014. Eye tracking and eye-based human--computer interaction. In Advances in physiological computing, 39--65. Springer
2014
-
[21]
Nonaka, S.; Nobuhara, S.; and Nishino, K. 2022. Dynamic 3d gaze from afar: Deep gaze estimation from temporal eye-head-body coordination. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2192--2201
2022
-
[22]
J.; and Choi, S.-I
O Oh, J.; Chang, H. J.; and Choi, S.-I. 2022. Self-attention with convolution and deconvolution for efficient eye gaze estimation from a full face image. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4992--5000
2022
-
[23]
Park, S.; Aksan, E.; Zhang, X.; and Hilliges, O. 2020. Towards end-to-end video-based eye-tracking. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23--28, 2020, Proceedings, Part XII 16, 747--763. Springer
2020
-
[24]
Patney, A.; Kim, J.; Salvi, M.; Kaplanyan, A.; Wyman, C.; Benty, N.; Lefohn, A.; and Luebke, D. 2016. Perceptually-based foveated virtual reality. In ACM SIGGRAPH 2016 emerging technologies, 1--2
2016
-
[25]
Permuter, H.; Francos, J.; and Jermyn, I. 2006. A study of Gaussian mixture models of color and texture features for image classification and segmentation. Pattern recognition, 39(4): 695--706
2006
-
[26]
Rahal, R.-M.; and Fiedler, S. 2019. Understanding cognitive and affective mechanisms in social psychology through eye-tracking. Journal of Experimental Social Psychology, 85: 103842
2019
-
[27]
Smith, B.; Yin, Q.; Feiner, S.; and Nayar, S. 2013. G aze L ocking: P assive E ye C ontact D etection for H uman? O bject I nteraction. In ACM Symposium on User Interface Software and Technology (UIST), 271--280
2013
-
[28]
Sugano, Y.; Matsushita, Y.; and Sato, Y. 2014. Learning-by-synthesis for appearance-based 3d gaze estimation. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1821--1828
2014
-
[29]
Valenti, R.; Sebe, N.; and Gevers, T. 2011. Combining head pose and eye location information for gaze estimation. IEEE Transactions on Image Processing, 21(2): 802--815
2011
-
[30]
Wang, K.; Peng, X.; Yang, J.; Lu, S.; and Qiao, Y. 2020. Suppressing uncertainties for large-scale facial expression recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 6897--6906
2020
-
[31]
Wei, Q.; Feng, L.; Sun, H.; Wang, R.; Guo, C.; and Yin, Y. 2023. Fine-grained classification with noisy labels. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11651--11660
2023
-
[32]
S.; Zhang, T.; and Barnes, N
Zhang, J.; Fan, D.-P.; Dai, Y.; Anwar, S.; Saleh, F. S.; Zhang, T.; and Barnes, N. 2020 a . UC-Net: Uncertainty inspired RGB-D saliency detection via conditional variational autoencoders. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 8582--8591
2020
-
[33]
Zhang, X.; Park, S.; Beeler, T.; Bradley, D.; Tang, S.; and Hilliges, O. 2020 b . Eth-xgaze: A large scale dataset for gaze estimation under extreme head pose and gaze variation. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23--28, 2020, Proceed...
2020
-
[34]
Zhang, X.; Sugano, Y.; Fritz, M.; and Bulling, A. 2017 a . It's written all over your face: Full-face appearance-based gaze estimation. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 51--60
2017
-
[35]
Zhang, X.; Sugano, Y.; Fritz, M.; and Bulling, A. 2017 b . Mpiigaze: Real-world dataset and deep appearance-based gaze estimation. IEEE transactions on pattern analysis and machine intelligence, 41(1): 162--175
2017
-
[36]
Zhou, C.; Huang, Y.; Pu, M.; Guan, Q.; Huang, L.; and Ling, H. 2023. The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detector. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 15507--15517
2023
-
[37]
Zhu, Z.; and Ji, Q. 2007. Novel eye gaze tracking techniques under natural head movement. IEEE Transactions on biomedical engineering, 54(12): 2246--2260
2007
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.