Pith. sign in

REVIEW 4 major objections 5 minor 33 references

Dataset combining EEG, eye-tracking, and high-speed video for ocular activity analysis across BCI paradigms

T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read New multimodal dataset combines EEG, eye-tracking, and video to study blinks across four BCI paradigms.

desk verdict A genuinely useful open multimodal BCI dataset with a few documented limitations; the symmetric-blinking assumption deserves a check, but the raw streams are the real deliverable. read the letter →

arxiv 2506.07488 v1 pith:PBWQZLXB submitted 2025-06-09 q-bio.NC

E. Guttmann-Flury , X. Sheng , X. Zhu This is my paper · ORCID
classification q-bio.NC
keywords EEGeye-trackinghigh-speedvideoblinkdetectionbrain-computerinterfacemotorimagerySSVEPP300
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper introduces a publicly available multimodal dataset that records electroencephalogram (EEG) brain signals, eye-tracking gaze data, and high-speed video of the left eye simultaneously, from 31 healthy volunteers across 63 sessions and four brain-computer interface (BCI) tasks. The authors' central claim is that this combination, together with questionnaires on each participant's mental state and physical characteristics, is unique in letting researchers study blinks and other eye movements with independent visual, electrical, and gaze-based evidence. Because blinks can either corrupt EEG or serve as intentional control signals, the dataset is meant to support algorithms that handle eye-induced artifacts and improve task classification, and to test how well BCI methods generalize across paradigms. The paper also reports quality checks, including per-subject blink statistics, signal-to-noise plots, and motor-imagery classification accuracies.

What carries the argument

The central mechanism is the synchronized multimodal acquisition pipeline. An Arduino Nano converts E-Prime trigger codes into square waves that regulate the Phantom camera shutter, while the same triggers go to the EEG system; a light sensor detected by the Tobii eye-tracker provides the common time reference, so every EEG sample, gaze point, and video frame can be compared. Blink detection relies on computer-vision tracking of eyelid landmarks in the video, cross-validated against EEG and EOG/EMG signals.

What would settle it

If a subject is recorded with separate bilateral video and EEG/EOG/EMG, and a substantial fraction of blinks show timing or amplitude differences between the two eyes (beyond a small tolerance), the single-eye video blink labels would misalign with right-eye signals, indicating that the dataset's cross-modal labels could be biased.

Watch

Extended reading notes

Core claim

The core contribution is the dataset itself: over 46 hours of recordings from 31 subjects, with 2,520 trials each of motor imagery, motor execution, and steady-state visually evoked potentials, and 5,670 P300 trials, all aligned to a common time base. EEG was sampled at 1000 Hz from 65 channels, the eye-tracker at 300 Hz, and the high-speed camera at 150 frames per second, with triggers from E-Prime synchronized to all three devices. Blink labels are provided in the EEG files, derived from video-based eyelid tracking, and the authors demonstrate inter-modal consistency by showing that frontopolar EEG, EOG, EMG, and video-derived eyelid movements align during blinks. The dataset is released under CC0 with code for data loading and reproduction.

Load-bearing premise

Blinking is assumed to be symmetric between the two eyes, which justifies recording only the left eye on video and using those eyelid positions to label blinks in the right-eye EOG/EMG electrodes.

Editorial extensions

If this is right

  • Researchers can train artifact-correction algorithms that exploit video-verified blink ground truth rather than EEG-only heuristics.
  • Because the same participants performed four paradigms, the dataset enables cross-paradigm generalization tests for BCI classifiers.
  • The per-subject blink statistics support studies of inter- and intra-subject variability in blink amplitude, width, and frequency.
  • The pupil-size and gaze data can be used to study cognitive load and attention differences across BCI tasks.
  • The dataset provides a benchmark for comparing blink correction methods such as ICA, ASR, and the authors' ABCD algorithm.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The single-eye video assumption could be empirically tested using the bilateral EOG/EMG and gaze data already in the dataset; if asymmetric blinks are common, future versions should record both eyes.
  • Because the high-speed camera stores only about seven minutes of video per run, the dataset cannot capture long-term blink changes; continuous webcam recordings could extend this coverage.
  • The facial-landmark and blink-width distributions might support new biometric identification studies, although the paper's anonymization claims would need scrutiny.
  • The acquisition design could be replicated with consumer hardware, such as a webcam and a budget EEG system, to test whether video-based blink ground truth remains reliable without a high-speed camera.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. This paper presents a multimodal dataset combining 65-channel EEG, Tobii TX300 eye-tracking, and high-speed video (Phantom M310) recorded from 31 participants across 63 sessions, with four BCI paradigms (motor imagery, motor execution, SSVEP, and P300 speller). The manuscript documents the acquisition setup, device synchronization via E-Prime, Arduino, and a light sensor, preprocessing steps, missing-data statistics, and technical validation including blink metrics, SNR/ERD/ERS, ERP, SSVEP, pupil analyses, and MI classification with the authors' ABCD algorithm compared with ICA and ASR. The data and code are made openly available online.

Significance. The dataset addresses a real gap in BCI research by providing synchronized EEG, eye-tracking, and high-speed video across multiple paradigms, which is valuable for studying ocular artifacts and developing robust artifact-correction methods. The paper is strong in its explicit synchronization protocol, detailed missing-data accounting, and inclusion of validation analyses with confidence intervals. The central claim—that a large multimodal dataset is available—is largely supported by the raw data availability. However, the reliability of the derived Blinks column, which underpins the cross-modal validation, rests on an unvalidated symmetry assumption, and several documentation errors weaken the paper's usability claims.

major comments (4)
  1. [Multimodal acquisition (p.7) and Fig. 7] The high-speed camera records only the left eye, and the Blinks column (Data records, Table 2) is used in Fig. 7 to argue that right-eye EMG/EOG and frontopolar EEG 'record similar patterns... in alignment with the eyelid movement data captured in the video recordings.' The symmetric-blinking assumption is stated but never quantitatively checked; partial blinks and lid lag can produce asymmetric onset/offset between the eyes. Because the Blinks column is a derived feature, this issue is load-bearing for the dataset's multimodal ocular-analysis purpose. Please provide a symmetry validation (e.g., a subset of binocular video recordings or a comparison of left-eye video with right-eye EOG/EMG) or explicitly scope the Blinks column as left-eye-only and soften the cross-modal validation claims.
  2. [Missing data section] The sentence listing eye-tracking trials that lack a common time reference for subject S06's first session includes 'MI241 and P3005L261,' but these identifiers correspond to S24 and S26, respectively, not to S06. This inconsistency makes the missing-data documentation unreliable for those files. Please correct the list and verify it against the public repository.
  3. [Data records, Table 2, and Preprocessing] The manuscript does not specify whether the Blinks column was generated from EEG signals (via the ABCD algorithm) or from high-speed video eyelid tracking. Table 2 shows Blink=1 at a time when FP1 amplitude is low (17.19 μV), suggesting video-derived timing, but the text in the Preprocessing section says 'Blinks are identified through the methodology outlined in [21]' (an EEG-based method). Downstream users will treat this column as ground truth, so the source and exact parameters must be stated explicitly.
  4. [Table 4] Several confidence intervals in Table 4 are impossible because they do not contain the point estimate; for example, S02 is listed as 89% [69%; 79%]. This indicates transcription errors in a key validation table. All entries should be rechecked and corrected.
minor comments (5)
  1. [Throughout] There are numerous typos and formatting errors, including 'opEN' in the running footer, 'Ver y' in Table 1 and the text, 'Edimburg' for 'Edinburgh', and a duplicated 'Multimodal acquisition' heading.
  2. [SNr plots section heading] The section heading 'SNr plots and data quality validation' uses an inconsistent abbreviation; it should be 'SNR' for clarity.
  3. [Background & Summary] The claim that the dataset 'uniquely provides simultaneous electrophysiological recordings, video capture, and synchronized eye-tracking' would be better supported by citing and comparing with existing EEG+eye-tracking datasets and specifying exactly which combination is new.
  4. [Table 1] The units for eye correction ('K dioptre') and the meaning of the 'Decile' column are not defined; please add a brief explanation in the table caption or methods.
  5. [a priori sample size estimation] This section is lengthy and relies on the authors' prior methods; a shorter summary focused on the chosen 63-session target would be more appropriate for a data descriptor.

Circularity Check

0 steps flagged · score 2.0 of 10

No significant circularity: the dataset construction is self-contained and its validation does not reduce to its inputs; the authors' prior methods appear as tooling rather than as hidden premises forcing the result.

full rationale

The paper's central claim is the creation and public release of a multimodal dataset (EEG, eye-tracking, high-speed video, questionnaires) across four BCI paradigms. Nothing in the dataset construction fits a parameter to a target and then repackages that fit as a prediction; the three acquisition streams were recorded independently with a common time base (Methods, Multimodal acquisition; Fig. 4). The 'Blinks' column is derived from video template matching of eyelid landmarks, while EEG blink detection uses the authors' prior ABCD methodology (ref. 21), and the validation in Fig. 7 correlates these independent modalities; neither quantity is defined in terms of the other by construction. The a priori sample-size justification (63 sessions, 46 hours) cites the authors' own earlier Monte Carlo method (ref. 14), and the accuracy benchmark compares their ABCD algorithm against ICA and ASR (Table 4). These are self-citations, but they are not load-bearing in the sense of forcing the central claim: the dataset's availability, size, and content do not depend on the truth of the cited methods, and the raw recordings are openly available for independent re-analysis. The stated assumption of symmetric blinking between the eyes (Methods, Multimodal acquisition: 'This setup allows for the extraction of eyelid position from the video, operating under the assumption of symmetric blinking between both eyes') is an unvalidated modeling assumption that could affect the video-derived blink labels, but it is a correctness and robustness limitation, not a circular derivation, because the video labels are not constructed from the EEG/EOG/EMG signals used for comparison. Overall, the paper derives no prediction from a fitted parameter and imports no uniqueness theorem from prior work, so circularity is minimal.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The central claim (dataset construction) rests on standard acquisition hardware, the assumption of symmetric blinking, and validation pipelines from the authors' prior work; no new theoretical entities are introduced.

free parameters (1)
  • LCSS threshold for defective channel detection
    Channels are flagged as defective when their LCSS falls beneath a predefined threshold (Preprocessing section); the threshold value is not stated.
assumptions (4)
  • domain assumption Symmetric blinking between left and right eyes
    Video focuses on the left eye, assuming symmetric blinking to generalize eyelid position to the right eye (Multimodal acquisition).
  • domain assumption Blink detection criteria from ref 21 are valid for this dataset
    Blinks identified via methodology of Guttmann-Flury et al. 2019 (Preprocessing).
  • domain assumption iBUG 300-W facial landmark detector generalizes to these photographs
    Facial landmarks extracted using a detector trained on iBUG 300-W (Participants).
  • domain assumption Monte Carlo power analysis with fitted distributions and assumed effect sizes (0.2 for blink variation, 0.1 for MI) justifies 63 sessions
    Sample size estimation relies on these effect sizes and distributional assumptions (Methods, a priori sample size estimation).

how reviews work

0 comments
Cite this review

Pith. "Pith review of Dataset combining EEG, eye-tracking, and high-speed video for ocular activity analysis across BCI paradigms." pith.science (2026). https://pith.science/paper/PBWQZLXB

@misc{pith2026250607488,
  author       = {Pith},
  title        = {Pith review of: Dataset combining EEG, eye-tracking, and high-speed video for ocular activity analysis across BCI paradigms},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PBWQZLXB}},
  note         = {Machine review of arXiv:2506.07488}
}
read the original abstract

In Brain-Computer Interface (BCI) research, the detailed study of blinks is crucial. They can be considered as noise, affecting the efficiency and accuracy of decoding users' cognitive states and intentions, or as potential features, providing valuable insights into users' behavior and interaction patterns. We introduce a large dataset capturing electroencephalogram (EEG) signals, eye-tracking, high-speed camera recordings, as well as subjects' mental states and characteristics, to provide a multifactor analysis of eye-related movements. Four paradigms -- motor imagery, motor execution, steady-state visually evoked potentials, and P300 spellers -- are selected due to their capacity to evoke various sensory-motor responses and potential influence on ocular activity. This online-available dataset contains over 46 hours of data from 31 subjects across 63 sessions, totaling 2520 trials for each of the first three paradigms, and 5670 for P300. This multimodal and multi-paradigms dataset is expected to allow the development of algorithms capable of efficiently handling eye-induced artifacts and enhancing task-specific classification. Furthermore, it offers the opportunity to evaluate the cross-paradigm robustness involving the same participants.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

33 extracted references · 23 canonical work pages

  1. [21]

    & Zhu, X

    Guttmann-Flury, E., Sheng, X., Zhang, D. & Zhu, X. A new algorithm for blink correction adaptive to inter- and intra-subject variability. Computers in Biology and Medicine 114, 103442, https://doi.org/10.1016/j.compbiomed.2019.103442 (2019)

    arXiv 2019

  2. [1]

    Tan, D. S. & Nijholt, A. (eds.). Brain-Computer Interfaces and Human-Computer Interaction, chap. 1. Brain-Computer Interfaces. Human-Computer Interaction Series (Springer, London, 2010)

    work page 2010

  3. [2]

    Mridha, M. F . et al. Brain-Computer Interface: Advancement and Challenges. Sensors (Basel) 21, 5746, https://doi.org/10.3390/ s21175746 (2021)

    work page 2021

  4. [3]

    Neurophysiologic Basis of EEG

    Olejniczak, P . Neurophysiologic Basis of EEG. Journal of Clinical Neurophysiology 23, 186–189, https://doi.org/10.1097/01. wnp.0000220079.61973.6c (2006)

    work page arXiv 2006

  5. [4]

    Urigüen, J. A. & Garcia-Zapirain, B. EEG artifact removal—state-of-the-art and guidelines. Journal of Neural Engineering12, https:// doi.org/10.1088/1741-2560/12/3/031001 (2015)

    doi:10.1088/1741-2560/12/3/031001 2015

  6. [5]

    O., Dworetzky, B

    Tatum, W . O., Dworetzky, B. A. & Schomer, D. L. Artifact and Recording Concepts in EEG. Journal of Clinical Neurophysiology 28, 252–263, https://doi.org/10.1097/WNP .0b013e31821c3c93 (2011)

    work page doi:10.1097/wnp 2011

  7. [6]

    & Strumiłło, P

    Królak, A. & Strumiłło, P . Eye-blink detection system for human–computer interaction. Universal Access in the Information Society 11, 409–419, https://doi.org/10.1007/s10209-011-0256-6 (2012)

    work page doi:10.1007/s10209-011-0256-6 2012

  8. [7]

    & Kitazawa, S

    Nakano, T., Y amamoto, Y ., Kitajo, K., Takahashi, T. & Kitazawa, S. Synchronization of spontaneous eyeblinks while viewing video stories. Proceedings of the Royal Society B: Biological Sciences 276, 3635–3644, https://doi.org/10.1098/rspb.2009.0828 (2009)

    work page arXiv 2009

Show all 33 references
  1. [8]

    & Tyler, C

    Jia, Y . & Tyler, C. W . Measurement of saccadic eye movements by electrooculography for simultaneous EEG recording. Behavior Research Methods 51, 2139–2151, https://doi.org/10.3758/s13428-019-01280-8 (2019)

    2019 doi

  2. [9]

    & Kübler, A

    Daly, I., Matran-Fernandez, A., Valeriani, D., Lebedev, M. & Kübler, A. Editorial: Datasets for Brain-Computer Interface Applications. Frontiers in Neuroscience 15, 732165, https://doi.org/10.3389/fnins.2021.732165 (2021)

    2021

  3. [10]

    & Sivakumar, R

    Agarwal, M. & Sivakumar, R. Blink: A Fully Automated Unsupervised Algorithm for Eye-Blink Detection in EEG Signals. In 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 1113–1121, https://doi.org/10.1109/ ALLERTON.2019.8919795 (2019)

    2019

  4. [11]

    & Pfurtscheller, G

    Brunner, C., Leeb, R., Müller-Putz, G., Schlögl, A. & Pfurtscheller, G. BCI Competition 2008–Graz data set A. Institute for knowledge discovery (laboratory of brain-computer interfaces), Graz University of Technology 16, 1–6, https://doi.org/10.21227/katb-zv89 (2008)

    2008 doi

  5. [12]

    Arvaneh, M., Guan, C., Ang, K. K. & Quek, C. Optimizing the Channel Selection and Classification Accuracy in EEG-based BCI. IEEE transactions on bio-medical engineering 58, 1865–1873, https://doi.org/10.1109/TBME.2011.2131142 (2011)

    2011

  6. [13]

    D.The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results (Cambridge University Press, Cambridge, 2010)

    Ellis, P . D.The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results (Cambridge University Press, Cambridge, 2010)

    2010

  7. [14]

    & Zhu, X

    Guttmann-Flury, E., Sheng, X., Zhang, D. & Zhu, X. A Priori Sample Size Determination for the Number of Subjects in an EEG Experiment. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 5180–5183, https://doi.org/10.110...

    2019

  8. [15]

    Oldfield, R. C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9, 97–113, https://doi. org/10.1016/0028-3932(71)90067-4 (1971)

    1971 doi

  9. [16]

    R., Struve, F

    Reeves, R. R., Struve, F . A. & Patrick, G. A Comprehensive Questionnaire for Subjects Undergoing Quantitative Research EEGs. Clinical Electroencephalography 29, 67–72, https://doi.org/10.1177/155005949802900204 (1998)

    1998 doi

  10. [17]

    & Pantic, M

    Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S. & Pantic, M. 300 Faces In-The-Wild Challenge: database and results. Image and Vision Computing 47, 3–18, https://doi.org/10.1016/j.imavis.2016.01.002 (2016)

    2016 doi

  11. [18]

    Farwell, L. A. & Donchin, E. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology 70, 510–523, https://doi.org/10.1016/0013-4694(88)90149-6 (1988)

    1988 doi

  12. [19]

    Townsend, G. et al. A novel P300-based brain-computer interface stimulus presentation paradigm: Moving beyond rows and columns. Clinical Neurophysiology 121, 1109–1120, https://doi.org/10.1016/j.clinph.2010.01.030 (2010)

    2010 doi

  13. [20]

    & Rivet, B

    Cecotti, H. & Rivet, B. One step beyond rows and columns flashes in the P300 speller: a theoretical description. International Journal of bioelectromagnetism 13, 39–41 (2010). Publisher: International Society for Bioelectromagnetism. 18Scientific Data | (2025) 12:587 | https:/...

    2010 doi

  14. [22]

    & Zhu, X

    Guttmann-Flury, E., Sheng, X., Zhang, D. & Zhu, X. Eye-BCI multimodal dataset. Synapse https://doi.org/10.7303/syn64005218 (2024)

    2024 doi

  15. [23]

    Doane, M. G. Interaction of Eyelids and Tears in Corneal Wetting and the Dynamics of the Normal Human Eyeblink. American Journal of Ophthalmology 89, 507–516, https://doi.org/10.1016/0002-9394(80)90058-6 (1980)

    1980 doi

  16. [24]

    Bentivoglio, A. R. et al . Analysis of Blink Rate Patterns in Normal Subjects. Movement Disorders 12, 1028–1034, https://doi. org/10.1002/mds.870120629 (1997)

    1997 doi

  17. [25]

    Blink-related dynamic switching between internal and external orienting networks while viewing videos

    Nakano, T. Blink-related dynamic switching between internal and external orienting networks while viewing videos. Neuroscience Research 96, 54–58, https://doi.org/10.1016/j.neures.2015.02.010 (2015)

    2015 doi

  18. [26]

    & Rucci, M

    Y ang, B., Intoy, J. & Rucci, M. Eye blinks as a visual processing stage. Proceedings of the National Academy of Sciences 121, e2310291121, https://doi.org/10.1073/pnas.2310291121 (2024)

    2024 doi

  19. [27]

    M., Maenner, S

    Willett, S. M., Maenner, S. K. & Mayo, J. P . The perceptual consequences and neurophysiology of eye blinks. Frontiers in Systems Neuroscience 17, 1242654, https://doi.org/10.3389/fnsys.2023.1242654 (2023)

    2023

  20. [28]

    Visualizations with statistical details: The ’ggstatsplot’ approach

    Patil, I. Visualizations with statistical details: The ’ggstatsplot’ approach. Journal of Open Source Software 6, 3167, https://doi. org/10.21105/joss.03167 (2021)

    2021 doi

  21. [29]

    & Boe, S

    Kraeutner, S., Gionfriddo, A., Bardouille, T. & Boe, S. Motor imagery-based brain activity parallels that of motor execution: Evidence from magnetic source imaging of cortical oscillations. Brain Research 1588, 81–91, https://doi.org/10.1016/j.brainres.2014.09.001 (2014)

    2014 doi

  22. [30]

    S., Jeon, Y ., Kim, Y .-J., Lee, I

    Nam, C. S., Jeon, Y ., Kim, Y .-J., Lee, I. & Park, K. Movement imagery-related lateralization of event-related (de)synchronization (ERD/ERS): Motor-imagery duration effects. Clinical Neurophysiology 122, 567–577, https://doi.org/10.1016/j.clinph.2010.08.002 (2011)

    2011 doi

  23. [31]

    Burianová, H. et al. Multimodal functional imaging of motor imagery using a novel paradigm. NeuroImage 71, 50–58, https://doi. org/10.1016/j.neuroimage.2013.01.001 (2013)

    2013 doi

  24. [32]

    & Sejnowski, T

    Makeig, S., Bell, A., Jung, T.-P . & Sejnowski, T. J. Independent Component Analysis of Electroencephalographic Data. In Advances in Neural Information Processing Systems, vol. 8 (MIT Press, 1995)

    1995

  25. [33]

    Kothe, C. A. E. & Jung, T.-P . Artifact removal techniques with signal reconstruction (2016). US Patent App. 14/895,440. acknowledgements This work is supported by the National Natural Science Foundation of China (Grant No. 91948302). author contributions E.G.F . participated ...

    2016

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.