REVIEW 2 major objections 4 minor 18 references
Connectome brain fingerprinting: terminology, measures, and target properties
T0 review · 2 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read Mean-difference brain identifiability scores can hide recognition failures
desk verdict A sound, well-scoped methodological caution: Idiff and Dself are mean-separation statistics that cannot summarize recognition performance, and the Beta simulation makes the counterexample point honestly; absence of real data limits prevalence estimates, not the core argument. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying object is the identifiability matrix: a square matrix of correlations between every participant's connectivity profile in one session and every participant's profile in a second session. Its main diagonal holds genuine scores (same person), its off-diagonal holds impostor scores (different people). $I_{\mathrm{diff}}$ is the percentage difference between the average diagonal and average off-diagonal; $D_{\mathrm{self}}$ is the same idea per subject, expressed as a z-score of a participant's self-correlation relative to their correlations with all others. The paper compares these summaries against the Equal Error Rate (EER), the point where false-accept and false-reject rates are equal, using 256 Beta-distributed scenarios. The mechanism carrying the argument is the contrast between mean separation (what $I_{\mathrm{diff}}$ and $D_{\mathrm{self}}$ report) and distribution overlap (what determines EER): two distributions can have the same mean gap yet very different overlap depending on dispersion, skewness, and tails.
What would settle it
Compute $I_{\mathrm{diff}}$, $D_{\mathrm{self}}$, and EER from the identifiability matrix of a large real test-retest dataset with hundreds of participants and two sessions, then count how often EER near zero coincides with low $I_{\mathrm{diff}}$, or high EER with high $I_{\mathrm{diff}}$; the paper's claim predicts such cases, and their absence in real data would weaken the practical conclusion.
Extended reading notes
Core claim
On the paper's own terms, the discovery is that $I_{\mathrm{diff}}$ and $D_{\mathrm{self}}$ measure the wrong target. An identifiability matrix contains correlations between every participant's profile at two sessions; diagonal entries are same-person ('genuine') scores and off-diagonal entries are cross-person ('impostor') scores. $I_{\mathrm{diff}}$ is the percentage difference between the average diagonal and the average off-diagonal, and $D_{\mathrm{self}}$ is a subject-level z-score of self-correlation relative to correlations with others. In 256 Beta-distributed simulation scenarios, EER correlated with $I_{\mathrm{diff}}$ at $r=-0.707$ and with average $D_{\mathrm{self}}$ at $r=-0.536$, yet at $\mathrm{EER}=0$ both measures varied widely, and similarly at poor EER values. The reason is that mean separation does not capture distribution overlap; because overlap, dispersion, skewness, and threshold determine false-accept and false-reject rates, $I_{\mathrm{diff}}$ and $D_{\mathrm{self}}$ can rate a perfectly separable system low and a badly overlapping system high. The paper's positive recommendation is to report EER or rank-k identification rate when the question is identification, and to stop calling mean-difference similarity scores 'fingerprinting.'
Load-bearing premise
The paper's warning depends on the assumption that Beta-distributed synthetic score distributions cover the realistic shapes of genuine and impostor similarity distributions in real test-retest brain data; if real data constrain those shapes, the practical frequency of disagreement between $I_{\mathrm{diff}}$ and EER might be lower than the simulation suggests.
Editorial extensions
If this is right
- Any connectome study reporting only $I_{\mathrm{diff}}$ or $D_{\mathrm{self}}$ should not be read as evidence that individuals can be identified; EER, ROC curves, or rank-k rates are needed to support that claim.
- Group comparisons of $I_{\mathrm{diff}}$—for example between patients and controls—are about average similarity differences, not about fingerprinting, and should not be described as identification.
- A reported high $I_{\mathrm{diff}}$ can coexist with high error rates, so results that rely on it alone may need to be rechecked with error-based metrics.
- Studies that do use rank-1 identification or EER already satisfy the biometric standard the paper defends, and their 'fingerprinting' terminology is the more appropriate one.
- New brain-based identification claims should report thresholds and the success and failure rates they imply, not just score separations.
Reading between the lines
- The paper declines to test real data, so a natural extension is to compute $I_{\mathrm{diff}}$, $D_{\mathrm{self}}$, and EER on existing test-retest fMRI/EEG/MEG datasets and measure how often their rankings disagree in practice; the paper's own logic predicts nontrivial disagreement.
- If the critique holds, earlier studies that used $I_{\mathrm{diff}}$ or $D_{\mathrm{self}}$ as their primary evidence for 'brain fingerprints' would need re-analysis with overlap-sensitive metrics, and some may not support individual identification.
- The same overlap argument applies beyond connectomes: any discipline that summarizes two score distributions by the gap between their means—genetic fingerprinting, chemical fingerprinting, device recognition—should prefer error-rate or AUC summaries when the question is recognition.
- A testable extension would be constructing a new identifiability index that includes distribution overlap, such as the area under the ROC curve of the identifiability matrix, and seeing whether it reconciles neuroscience practice with biometric standards.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript argues that connectome 'brain fingerprinting' metrics such as differential identifiability (Idiff) and Dself, which are based on mean differences between within- and between-subject similarities, do not adequately characterize biometric recognition performance because they ignore the overlap, dispersion, and shape of genuine and impostor score distributions. It reviews biometric verification and identification terminology, simulates 256 Beta-distributed identifiability matrices, and shows that EER can be near zero while Idiff and Dself vary over a wide range, and vice versa. The authors conclude that Idiff and Dself should not be used alone in fingerprinting claims and recommend standard metrics such as rank-k identification rate or EER.
Significance. The mathematical observation is correct and the simulation provides a clean counterexample to the interpretation of Idiff and Dself as recognition-performance measures. The paper contributes a useful terminological and conceptual cleanup by linking neuroscience practice to established biometric standards, and the recommendation to report rank-k or EER as primary metrics is sensible. The availability of simulation code is a strength, and the authors' modal language ('could lead', 'may provide') is appropriately cautious. The main limitation is that the practical prevalence of the misleading cases is not quantified with real data, but this does not affect the logical validity of the core counterexample.
major comments (2)
- [Section IV, Figures 1-3] The simulation demonstrates that Idiff and Dself are poorly related to EER, which the authors themselves classify as a verification metric in Section II. However, the conclusion and the practical recommendations are framed around 'fingerprinting' and 'identifiability', i.e., identification, for which the accepted metric is rank-k or the CMC. The current evidence therefore does not directly support the identification-specific claim. Please provide a parallel simulation with rank-1 identification accuracy, or explicitly limit the conclusion to verification contexts and explain why the identification conclusion follows from the same construction.
- [Section IV] The simulation is not fully described in the text. The number of simulated subjects/identities, the dimension of the identifiability matrices, the procedure for generating diagonal and off-diagonal entries (independence, symmetry, number of Monte Carlo replications), and the method used to compute EER are not specified. These details are necessary for reproducibility; the linked code is welcome, but the text should be self-contained.
minor comments (4)
- [Section V] The statement 'Including an analysis based on real data seems superfluous in this context' is too dismissive. A real-data demonstration would strengthen the practical relevance of the recommendation, even though the logical counterexample does not require it.
- [Equations (1) and (2)] The formulas lack parentheses: equation (1) should read (Iself - Iothers) × 100, and equation (2) should read (Corr_ii - μ_ij)/σ_ij.
- [Section IV] The Pearson correlation coefficients are reported as '-.707' and '-.536'; the conventional notation is '-0.707' and '-0.536'.
- [Section IV] The text says 'Alpha and beta parameters were derived from different mean and standard deviation values to define a total of 256 different scenarios' but does not specify how the mean and standard deviation values were chosen; a brief description or a supplementary table would clarify the design.
Circularity Check
No significant circularity: the critique of Idiff/Dself rests on an external standard (EER), and the one self-citation is peripheral.
full rationale
The paper's central argument is that Idiff and Dself compute mean-based separation of genuine and impostor scores and therefore cannot summarize recognition performance, which depends on overlap, dispersion, and shape. This is verified against Equations (1) and (2) and tested by simulation against EER, an independently defined biometric metric; the Beta-distributed identifiability matrices provide a counterexample rather than being fitted to the conclusion. The passage 'Idiff, by construction, provides an estimate of the distance between the average of the main diagonal elements ... but does not consider the overlap between the two distributions' explicitly identifies the definitional property at issue, and no prediction is generated from data that were first used to tune a parameter. The only self-citation, reference [7] (Demuru and Fraschini), appears in a list of alternative fingerprints and is not load-bearing for the argument. The decision to omit real data, defended as 'superfluous in this context,' limits practical prevalence claims but does not introduce circularity. There is no fitted input renamed as prediction, no uniqueness theorem imported from the authors, and no ansatz smuggled in via citation. The central claim has independent mathematical and simulation content.
Assumptions & free parameters
free parameters (1)
- Beta distribution shape parameters (alpha, beta) =
varied across 256 scenarios
assumptions (3)
- domain assumption Genuine and impostor matching scores are independent Beta random variables on [0,1].
- domain assumption EER is the appropriate gold-standard summary of verification performance that Idiff and Dself should track.
- domain assumption The mean genuine score exceeds the mean impostor score, but no other constraint is imposed on the score distributions.
Cite this review
Pith. "Pith review of Connectome brain fingerprinting: terminology, measures, and target properties." pith.science (2026). https://pith.science/paper/B7Z6YZOB
@misc{pith2026250605769,
author = {Pith},
title = {Pith review of: Connectome brain fingerprinting: terminology, measures, and target properties},
year = {2026},
howpublished = {\url{https://pith.science/paper/B7Z6YZOB}},
note = {Machine review of arXiv:2506.05769}
}
read the original abstract
Distinguishing one person from another (what biometricians call recognition) is extremely relevant for different aspects of life. Traditional biometric modalities (fingerprint, face, iris, voice) rely on unique, stable features that reliably differentiate individuals. Recently, the term fingerprinting has gained popularity in neuroscience, with a growing number of studies adopting the term to describe various brain based metrics derived from different techniques. However, we think there is a mismatch between its widely accepted meaning in the biometric community and some brain based metrics. Many of these measures do not satisfy the strict definition of a biometric fingerprint that is, a stable trait that uniquely identifies an individual. In this study we discuss some issues that may generate confusion in this context and suggest how to treat the question in the future. In particular, we review how fingerprint is currently used in the neuroscience literature, highlight mismatches with the biometric community definition, and offer clear guidelines for distinguishing genuine biometric fingerprints from exploratory similarity metrics. By clarifying terminology and criteria, we aim to align practices and facilitate communication across fields.
Figures
Reference graph
Works this paper leans on
-
[1]
1 Abstract—Distinguishing one person from another—what biometricians call recognition —is extremely relevant for different aspects of life. Traditional biometric modalities (fingerprint, face, iris, voice) rely on unique, stable features that reliably differentiate individuals. Recently, the term “fingerprinting” has gained popularity in neuroscience, wit...
work page 2015
-
[2]
For an identification system, the most commonly used metric is the rank-k identification rate (Rk), which is the number of times the correct identity appears within the top k most likely candidates. The Cumulative Match Characteristic (CMC) curve plots Rank- performance against k and provides a visual representation of the system’s performance across diff...
work page 2018
-
[3]
Q. Gui, M. V. Ruiz-Blondet, S. Laszlo, e Z. Jin, «A Survey on Brain Biometrics», ACM Comput. Surv., vol. 51, fasc. 6, p. 112:1-112:38, feb. 2019, doi: 10.1145/3230632
doi:10.1145/3230632 2019
-
[4]
J. L. Wayman, «Biometric Verification/Identification/Authentication/Recognition: The Terminology», in Encyclopedia of Biometrics, S. Z. Li e A. Jain, A c. di, Boston, MA: Springer US, 2009, pp. 153–157. doi: 10.1007/978-0-387-73003-5_206
-
[5]
E. S. Finn et al., «Functional connectome fingerprinting: identifying individuals using patterns of brain connectivity», Nature Neuroscience, vol. 18, fasc. 11, pp. 1664–1671, nov. 2015, doi: 10.1038/nn.4135
doi:10.1038/nn.4135 2015
- [6]
-
[7]
M. Demuru e M. Fraschini, «EEG fingerprinting: subject-specific signature based on the aperiodic component of power spectrum», Computers in Biology and Medicine, vol. 120, pp. 1–5, 2020, doi: 10.1016/j.compbiomed.2020.103748
-
[8]
D. La Rocca et al., «Human Brain Distinctiveness Based on EEG Spectral Coherence Connectivity», IEEE Transactions on Biomedical Engineering, vol. 61, fasc. 9, pp. 2406–2412, set. 2014, doi: 10.1109/TBME.2014.2317881
Show all 18 references
-
[9]
DelPozo-Banos, C
M. DelPozo-Banos, C. M. Travieso, C. T. Weidemann, e J. B. Alonso, «EEG biometric identification: a thorough exploration of the time-frequency domain», J Neural Eng, vol. 12, fasc. 5, p. 056019, ott. 2015, doi: 10.1088/1741-2560/12/5/056019
2015 doi
-
[10]
Chan, P.-C
H.-L. Chan, P.-C. Kuo, C.-Y. Cheng, e Y.-S. Chen, «Challenges and Future Perspectives on Electroencephalogram-Based Biometrics in Person Recognition», Front Neuroinform, vol. 12, ott. 2018, doi: 10.3389/fninf.2018.00066
2018
-
[11]
Amico e J
E. Amico e J. Goñi, «The quest for identifiability in human functional connectomes», Sci Rep, vol. 8, fasc. 1, Art. fasc. 1, mag. 2018, doi: 10.1038/s41598-018-25089-1
2018 doi
-
[12]
da Silva Castanheira, H
J. da Silva Castanheira, H. D. Orozco Perez, B. Misic, e S. Baillet, «Brief segments of neurophysiological activity enable individual differentiation», Nat Commun, vol. 12, fasc. 1, p. 5713, set. 2021, doi: 10.1038/s41467-021-25895-8
2021 doi
-
[13]
J. da S. Castanheira et al., «The neurophysiological brain-fingerprint of Parkinson’s disease», eBioMedicine, vol. 105, lug. 2024, doi: 10.1016/j.ebiom.2024.105201
2024
-
[14]
Stampacchia et al., «Fingerprints of brain disease: connectome identifiability in Alzheimer’s disease», Commun Biol, vol
S. Stampacchia et al., «Fingerprints of brain disease: connectome identifiability in Alzheimer’s disease», Commun Biol, vol. 7, fasc. 1, pp. 1–16, set. 2024, doi: 10.1038/s42003-024-06829-8
2024 doi
-
[15]
Ambrosanio et al., «The Effect of Sleep Deprivation on Brain Fingerprint Stability: A Magnetoencephalography Validation Study», Sensors, vol
M. Ambrosanio et al., «The Effect of Sleep Deprivation on Brain Fingerprint Stability: A Magnetoencephalography Validation Study», Sensors, vol. 24, fasc. 7, Art. fasc. 7, gen. 2024, doi: 10.3390/s24072301
2024 doi
-
[16]
Cipriano et al., «Brain fingerprint and subjective mood state across the menstrual cycle», Front
L. Cipriano et al., «Brain fingerprint and subjective mood state across the menstrual cycle», Front. Neurosci., vol. 18, dic. 2024, doi: 10.3389/fnins.2024.1432218
2024
-
[17]
J. W. Lockhart, A. Fuentes, G. Rippon, e L. Eliot, «Not so binary or generalizable: Brain sex differences with artificial neural networks», Proceedings of the National Academy of Sciences, vol. 122, fasc. 2, p. e2411917121, gen. 2025, doi: 10.1073/pnas.2411917121
2025 doi
-
[2006]
doi: 10.1007/0-387-33123-9
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.