Pith. sign in

REVIEW 3 major objections 4 minor 33 references

SeizeIT2: Wearable Dataset Of Patients With Focal Epilepsy

T0 review · 3 major / 4 minor · reviewed 2026-08-09 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper presents SeizeIT2, a public multimodal wearable dataset from 125 patients with focal epilepsy, containing over 11,000 hours of synchronized behind-the-ear EEG, ECG, EMG, and movement data with 886 expert-annotated seizures, plus…

desk verdict SeizeIT2 is a genuinely useful open wearable focal epilepsy dataset, but the paper needs to fix count inconsistencies and document the vEEG-to-wearable alignment before the ground truth is fully bankable. read the letter →

arxiv 2502.01224 v1 pith:WWOALLXG submitted 2025-02-03 eess.SP

Miguel Bhagubai , Christos Chatzichristos , Lauren Swinnen , Jaiver Macea , Jingwei Zhang , Lieven Lagae , Katrien Jansen , Andreas Schulze-Bonhage
show 5 more authors
Francisco Sales Benno Mahler Yvonne Weber Wim Van Paesschen Maarten De Vos
This is my paper · ORCID
classification eess.SP
keywords focalepilepsywearableEEGseizuredetectionmultimodalmonitoringbehind-the-earpublicbenchmarkdatasetBIDSformatannotation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

SeizeIT2 is presented as the first open dataset of wearable physiological recordings from patients with focal epilepsy, created to give the seizure-detection community a standardized public resource for developing automated detection. It contains more than 11,000 hours of synchronized behind-the-ear EEG, ECG, EMG, and movement data from 125 patients across five European epilepsy monitoring centers, along with 886 expert-annotated focal seizures. The paper argues that no such public multimodal wearable dataset existed before, so algorithms have had to train on hospital-scale EEG or small private recordings, limiting generalization. It provides a fixed training/validation split and two baseline detectors, so future methods can be compared on the same data and metrics. If the dataset is sound, it lowers the barrier to building practical outpatient seizure monitoring and makes results reproducible.

What carries the argument

The carrying mechanism is the curated multimodal dataset itself, organized as synchronized recordings from two small wearable modules: one behind-the-ear module records two channels of bte-EEG at 250 Hz, and a chest module records ECG, EMG, and movement at 25 Hz. Expert annotations from full-scalp vEEG and video are aligned to the wearable traces, so each labeled seizure window carries type, lateralization, localization, and whether it is visible in the wearable channels. The fixed 80/20 patient split, the file layout in the Brain Imaging Data Structure (BIDS) format, and the two baseline pipelines convert the raw recordings into a common evaluation platform.

What would settle it

Independently re-annotate a random sample of 50 of the 886 seizures from the synchronized vEEG and video, recording each seizure's onset time without knowledge of the wearable labels, and compare onset times to the provided annotations; systematic offsets above a few seconds or low inter-rater agreement would demonstrate that the wearable ground truth is not trustworthy.

Watch

Extended reading notes

Core claim

The central claim is that a large, multicenter, public dataset of wearable data from patients with focal epilepsy now exists and is usable as a benchmark. The dataset pairs a lightweight behind-the-ear EEG device with ECG, EMG, accelerometer, and gyroscope channels, and lines up every wearable recording with expert vEEG/video-based seizure annotations, including seizure type, lateralization, localization, and visibility. The authors release it in a standard neuroimaging data organization, with a prespecified split into 96 training patients and 29 validation patients, plus feature-based (SVM) and deep-learning (ChronoNet) baselines and standard sensitivity/false-alarm metrics. Their stated purpose is to enable the development and fair comparison of automated focal seizure detection methods for continuous monitoring outside the hospital.

Load-bearing premise

The expert annotations and their alignment to the wearable traces are correct, meaning every labeled seizure is truly a seizure and occurs at the labeled time in the wearable data.

Editorial extensions

If this is right

  • Seizure-detection models can be trained and validated on standardized multimodal wearable data instead of hospital-scale EEG, which should make results more reproducible and comparable.
  • New algorithms can be measured against the reported SVM and ChronoNet baselines, giving the field reference points for sensitivity and false-alarm rate.
  • The public release makes it possible to study how much ECG, EMG, and movement information adds to bte-EEG alone for focal seizure detection.
  • Because the split is prespecified, later papers can report directly comparable numbers on the same validation set.
  • A successful detection system built on this data could support outpatient monitoring, where seizure diaries currently miss more than half of seizures.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The two baselines are generic detectors trained across patients; the paper does not explore per-patient adaptation, so testing whether personalization reduces the reported false-alarm rates is a natural extension.
  • Because 43% of seizures have unknown lateralization and many have unknown onset lobe, the dataset makes it possible to ask how much of the detection difficulty comes from annotation uncertainty rather than sensor noise, a question the paper leaves open.
  • The inclusion of subclinical and unknown-onset seizure labels invites exploration of detectors for seizures that lack clear behavioral or scalp correlates, though the paper does not validate that use.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper introduces SeizeIT2, described as the first open dataset of wearable data recorded in patients with focal epilepsy. The dataset comprises more than 11,000 hours of multimodal wearable recordings (bte-EEG, ECG, EMG, accelerometer and gyroscope) from 125 patients across five European Epilepsy Monitoring Centers, with 886 focal seizures annotated by clinicians on the basis of simultaneous full-scalp vEEG and video. The manuscript also proposes a training/validation split and presents two benchmark seizure detectors, a feature-based SVM and a deep-learning ChronoNet model, with epoch-based and any-overlap evaluation metrics. The data are publicly available on OpenNeuro in BIDS format, and code is provided via a GitHub repository.

Significance. If the dataset and its annotations are trustworthy, SeizeIT2 would fill a clear gap in the epilepsy monitoring literature: there are currently no publicly available wearable multimodal datasets from patients with focal epilepsy, and this release could enable reproducible development of wearable seizure detectors. The strengths are the large size (11,640 hours, 886 seizures, 125 patients), the multicenter design, the BIDS-compliant format, the public repository, and the open code for loading and benchmarking. These features make the resource potentially very valuable to the seizure detection community. However, the current manuscript gives limited evidence for the reliability of the seizure labels, which are the foundation of both the dataset and the benchmark evaluations. The unresolved counting inconsistencies and the missing annotation-alignment protocol are therefore central concerns that need to be addressed before the resource can be used with confidence.

major comments (3)
  1. [Dataset Content and Table 1] The seizure count bookkeeping is internally inconsistent. Table 1 sums to 886 seizures, and 317 FA + 393 FIA = 710, leaving 176 remaining seizures. However, the text in the Dataset Content section states that the remaining seizures comprise 55 FBTC, 12 with unclear awareness status, 2 subclinical focal seizures, and 93 with unknown or unreported onset, which sums to 162. The table lists instead 55 FBTC, 98 Focal, 17 Subclinical, and 6 Unknown, summing to 176. The discrepancy of 14 and the mismatched category sizes (e.g., 12 versus 98 for unclear awareness) need to be resolved. Since the dataset's value depends on accurate annotation metadata, this inconsistency weakens the claim that the data bookkeeping is reliable.
  2. [Technical Validation] The annotation alignment protocol is not described. The paper states that 'the annotations and the wearable data of this dataset were carefully aligned with the full-scalp EEG data' and that seizures not visible in the wearable data are still true seizures, but it does not specify how onsets and offsets were transferred from vEEG/video to the wearable streams, how alignment errors were measured or bounded, whether any inter-rater agreement was assessed, or how seizures with no wearable correlate were handled. Because every event in the _events.tsv files and every benchmark metric in Table 2 depends on these labels, a systematic alignment offset of even a few seconds would degrade the bte-EEG training and evaluation windows. The paper should include a detailed annotation and alignment protocol, along with inter-rater statistics or an equivalent validation of label reliability.
  3. [Seizure detection, Table 2 and following paragraph] The benchmark narrative contradicts the reported numbers. The text states that 'the maximum sensitivity is lower' for ChronoNet and that the SVM has a more suitable sensitivity/false-alarm trade-off, yet Table 2 reports ChronoNet sensitivity 84.2 versus SVM 71.1 at the decision threshold of 0.5. If 'maximum sensitivity' refers to the extreme of the sensitivity/false-alarm curve rather than the operating point in Table 2, this should be stated explicitly with the corresponding values from Figure 5. As written, the comparison is internally inconsistent and could mislead readers who use Table 2 as the reference benchmark.
minor comments (4)
  1. [Dataset Content] The phrase 'focal-to-bilateral tonic clinic' contains a typo; 'clinic' should be 'clonic' (focal-to-bilateral tonic-clonic).
  2. [Table 1] The column header 'Focal' is ambiguous alongside FA, FIA, FBTC, Subclinical, and Unknown; consider renaming it to something like 'Focal, unknown awareness' to align with standard ILAE terminology and with the text's description of 'unclear awareness status'.
  3. [Background & Summary] The phrase 'first and largest phase 3 clinical study' is unclear: is 'phase 3' a reference to the third iteration of the SeizeIT project, or to a clinical trial phase? Please clarify the terminology.
  4. [Figure 5] Figure 5 is described as a sensitivity/false-alarm-rate curve, but the axes and the operating points corresponding to Table 2 (threshold 0.5) are not described in the text; adding these annotations would improve interpretability.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the dataset itself is the deliverable, and the benchmark results do not reduce to fitted inputs or self-citations.

full rationale

The paper's central claim is the creation and public release of a wearable focal-epilepsy dataset, not a derived scientific result in which a parameter is fitted and then renamed as a prediction. The two benchmark detectors (SVM and ChronoNet) are explicitly presented as baselines, trained on an 80% patient split and evaluated on a held-out 20% patient split, so their evaluation metrics are not forced by construction. The seizure annotations come from epileptologists reviewing vEEG and video, i.e., an external clinical source rather than an output of the proposed models; the absence of a detailed alignment protocol and inter-rater statistics is a transparency/correctness concern, not a circularity one. Self-citations to prior group work (e.g., Vandecasteele et al. 2020, Bhagubai et al. 2023/2024) supply background methods and device development but are not load-bearing for the dataset's existence or content, and removing them would not change the dataset's availability. The internal count inconsistency for seizure subtypes is an annotation-bookkeeping issue that does not make any claim equivalent to its own input. No quoted equation or construction exhibits a circular reduction, so the appropriate finding is no significant circularity.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The central claim is a data release, so there are no fitted constants or invented physical entities. The load-bearing assumptions are about annotation quality, time alignment, and device fidelity, all of which are plausible but not independently verified in the manuscript.

assumptions (3)
  • domain assumption Seizure annotations based on vEEG and video are accurate ground truth.
    Technical Validation states that epileptologists annotated seizures from vEEG and video. All downstream labels and benchmarks inherit any annotation errors.
  • domain assumption Wearable data and full-scalp EEG are correctly time-aligned.
    Technical Validation says alignment was done 'carefully', but no quantitative alignment verification procedure is described.
  • domain assumption The Sensor Dot device captures the intended physiological signals with sufficient fidelity for seizure detection.
    Recording Setup describes the device and the paper acknowledges technical failures and corrupted recordings, but fidelity is assumed for the unremoved data.

how reviews work

0 comments
Cite this review

Pith. "Pith review of SeizeIT2: Wearable Dataset Of Patients With Focal Epilepsy." pith.science (2026). https://pith.science/paper/WWOALLXG

@misc{pith2026250201224,
  author       = {Pith},
  title        = {Pith review of: SeizeIT2: Wearable Dataset Of Patients With Focal Epilepsy},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WWOALLXG}},
  note         = {Machine review of arXiv:2502.01224}
}
read the original abstract

The increasing technological advancements towards miniaturized physiological measuring devices have enabled continuous monitoring of epileptic patients outside of specialized environments. The large amounts of data that can be recorded with such devices holds significant potential for developing automated seizure detection frameworks. In this work, we present SeizeIT2, the first open dataset of wearable data recorded in patients with focal epilepsy. The dataset comprises more than 11,000 hours of multimodal data, including behind-the-ear electroencephalography, electrocardiography, electromyography and movement (accelerometer and gyroscope) data. The dataset contains 886 focal seizures recorded from 125 patients across five different European Epileptic Monitoring Centers. We present a suggestive training/validation split to propel the development of AI methodologies for seizure detection, as well as two benchmark approaches and evaluation metrics. The dataset can be accessed on OpenNeuro and is stored in Brain Imaging Data Structure (BIDS) format.

Figures

Figures reproduced from arXiv: 2502.01224 by the authors.

Figure 1
Figure 1. Number of participants per EMU included in the SeizeIT2. The dataset includes patients from 5 different centers across 4 different European countries. Recording Setup The participants were recorded with the specific center’s vEEG monitoring equipment, where the EEG electrodes were placed according to the 10-20 system or the 25-electrode array of the International Federation of Clinical Neurophysiology. The SD device… view at source ↗
Figure 2
Figure 2. Schematic of the placement of the Sensor Dot device. The example in the figure shows the setup for measuring patients with a suspected history of focal seizure occurrences with onset on the left hemisphere, with two electrodes behind the left ear and one on the right. Adapted from30 . was a predominance of seizures with onset on the left hemisphere (44%). In 12% of the seizures, the onset was located in the right he… view at source ↗
Figure 3
Figure 3. File hierarchy of the repository. Butterworth filters (0.5 Hz high-pass, 60 Hz low-pass and 50 Hz notch filters). The training data is balanced in the same way as the feature-based method, choosing randomly five times the number of seizure segments for the background data segments. The evaluation was done with both the traditional epoch-based and the any-overlap methods34. Before evaluation, the model’s classificati… view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Number of seizures per main type in the training and validation sets [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]
Figure 5
Figure 5. Figure 5: Sensitivity - false alarm rate per hour curve frameworks such as added undesirable noise, lower data quality and decreased measurement reliability since the SD can be prone to technical errors and the measurement setup is not standardized. The clinical validation of th…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

33 extracted references · 26 canonical work pages

  1. [1]

    Steinmetz, J. D. et al. Global, regional, and national burden of disorders affecting the nervous system, 1990–2021: a systematic analysis for the Global Burden of Disease Study 2021.The Lancet Neurol.23, 344–381, 10.1016/s1474-4422(24) 00038-3 (2024). 7/9

    work page doi:10.1016/s1474-4422(24 2024

  2. [3]

    Fisher, R. S. et al. Epileptic seizures and Epilepsy: Definitions proposed by the International League against Epilepsy (ILAE) and the International Bureau for Epilepsy (IBE). Epilepsia 46, 470–472, 10.1111/j.0013-9580.2005.66104.x (2005)

    arXiv 2005

  3. [4]

    & McGonigal, A

    Chauvel, P. & McGonigal, A. Emergence of semiology in epileptic seizures. Epilepsy & Behav. 38, 94–103, 10.1016/j. yebeh.2013.12.003 (2014)

    doi:10.1016/j 2014

  4. [5]

    Fisher, R. S. et al. Operational classification of seizure types by the International League Against Epilepsy: Position Paper of the ILAE Commission for Classification and Terminology. Epilepsia 58, 522–530, 10.1111/epi.13670 (2017)

    work page doi:10.1111/epi.13670 2017

  5. [6]

    Bruno, E. et al. Wearable technology in epilepsy: The views of patients, caregivers, and healthcare professionals. Epilepsy & Behav. 85, 141–149, 10.1016/j.yebeh.2018.05.044 (2018)

    doi:10.1016/j.yebeh.2018.05.044 2018

  6. [7]

    D., Ryvlin, P

    Thijs, R. D., Ryvlin, P. & Surges, R. Autonomic manifestations of epilepsy: emerging pathways to sudden death? Nat. Rev. Neurol. 17, 774–788, 10.1038/s41582-021-00574-w (2021)

    work page doi:10.1038/s41582-021-00574-w 2021

  7. [8]

    & Puig, J

    Salas-Puig, X., Iniesta, M., Abraira, L. & Puig, J. Accidental injuries in patients with generalized tonic–clonic seizures. A multicenter, observational, cross-sectional study (QUIN-GTC study). Epilepsy & Behav. 92, 135–139, 10.1016/j.yebeh. 2018.10.043 (2019)

    work page doi:10.1016/j.yebeh 2019

  8. [9]

    & Elger, C

    Hoppe, C., Poepel, A. & Elger, C. E. Epilepsy: Accuracy of Patient Seizure Counts. Arch. Neurol. 64, 1595, 10.1001/ archneur.64.11.1595 (2007)

    work page 2007

Show all 33 references
  1. [10]

    Swinnen, L. et al. Accurate detection of typical absence seizures in adults and children using a two-channel electroen- cephalographic wearable behind the ears. Epilepsia 62, 2741–2752 (2021)

    2021

  2. [11]

    Presurgical evaluation of epilepsy

    Rosenow, F. Presurgical evaluation of epilepsy. Brain 124, 1683–1700, 10.1093/brain/124.9.1683 (2001)

    2001 doi

  3. [12]

    D., Dewar, S., Haneef, Z

    Moseley, B. D., Dewar, S., Haneef, Z. & Stern, J. M. How long is long enough? The utility of prolonged inpatient video EEG monitoring. Epilepsy Res. 109, 9–12, 10.1016/j.eplepsyres.2014.10.011 (2014)

    2014 doi

  4. [13]

    Wang, E. T.et al. Seizure count forecasting to aid diagnostic testing in epilepsy. Epilepsia 63, 3156–3167, 10.1111/epi. 17415 (2022)

    2022 doi

  5. [14]

    & Snyder, M

    Dunn, J., Runge, R. & Snyder, M. Wearables and the medical revolution. Pers. Medicine 15, 429–448, 10.2217/ pme-2018-0044 (2018)

    2018

  6. [15]

    Online; accessed 24 September 2014

    Byteflies. Online; accessed 24 September 2014

    2014

  7. [16]

    Comparison between Scalp EEG and Behind-the-Ear EEG for Development of a Wearable Seizure Detection System for Patients with Focal Epilepsy

    Gu, Y .et al. Comparison between Scalp EEG and Behind-the-Ear EEG for Development of a Wearable Seizure Detection System for Patients with Focal Epilepsy. Sensors 18, 29, 10.3390/s18010029 (2017)

    2017 doi

  8. [17]

    Vandecasteele, K. et al. Visual seizure annotation and automated seizure detection using behind-the-ear electroencephalo- graphic channels. Epilepsia 61, 766–775, 10.1111/epi.16470 (2020)

    2020 doi

  9. [18]

    Leijten, F. S. S. Multimodal seizure detection: A review. Epilepsia 59, 42–47, 10.1111/epi.14047 (2018)

    2018 doi

  10. [19]

    Vandecasteele, K. et al. The power of ECG in multimodal patient-specific seizure monitoring: Added value to an EEG-based detector using limited channels. Epilepsia 62, 2333–2343, 10.1111/epi.16990 (2021)

    2021 doi

  11. [20]

    Bhagubai, M. et al. The power of ECG in Semi-Automated seizure detection in addition to Two-Channel Behind-the-Ear EEG. Bioengineering 10, 491, 10.3390/bioengineering10040491 (2023)

    2023 doi

  12. [21]

    K., Morales-Menendez, R., Huang, X

    Siddiqui, M. K., Morales-Menendez, R., Huang, X. & Hussain, N. A review of epileptic seizure detection using machine learning classifiers. Brain informatics 7, 5 (2020)

    2020

  13. [22]

    & Contreras-Vidal, J

    Craik, A., He, Y . & Contreras-Vidal, J. L. Deep learning for electroencephalogram (eeg) classification tasks: a review.J. neural engineering 16, 031001 (2019)

    2019

  14. [23]

    De Cooman, T. et al. Online Automated Seizure detection in temporal lobe Epilepsy patients using Single-lead ECG. Int. J. Neural Syst. 27, 1750022, 10.1142/s0129065717500228 (2017)

    2017 doi

  15. [24]

    & Wolf, P

    Beniczky, S., Conradsen, I., Henning, O., Fabricius, M. & Wolf, P. Automated real-time detection of tonic-clonic seizures using a wearable EMG device. Neurology 90, 10.1212/wnl.0000000000004893 (2018)

    2018 doi

  16. [25]

    Chatzichristos, C. et al. Multimodal detection of typical absence seizures in home environment with wearable electrodes. Front. Signal Process. 2, 1014700 (2022). 8/9

    2022

  17. [26]

    Swinnen, L. et al. Home recording of 3-hz spike–wave discharges in adults with absence epilepsy using the wearable sensor dot. Epilepsia 65, 378–388 (2024)

    2024

  18. [27]

    & Van Paesschen, W

    Macea, J., Bhagubai, M., Broux, V ., De V os, M. & Van Paesschen, W. In-hospital and home-based long-term monitoring of focal epilepsy with a wearable electroencephalographic device: Diagnostic yield and user experience. Epilepsia 64, 937–950 (2023)

    2023

  19. [28]

    & Goel, N

    Handa, P., Mathur, M. & Goel, N. EEG datasets in machine learning applications of epilepsy diagnosis and seizure Detection. SN Comput. Sci. 4, 10.1007/s42979-023-01958-z (2023)

    2023 doi

  20. [29]

    Dan, J. et al. SzCORE: Seizure Community Open-Source Research Evaluation framework for the validation of electroencephalography-based automated seizure detection algorithms. Epilepsia 10.1111/epi.18113 (2024)

    2024 doi

  21. [30]

    Bhagubai, M. et al. Towards automated seizure detection with wearable eeg – grand challenge. IEEE Open J. Signal Process. 5, 717–724, 10.1109/OJSP.2024.3378604 (2024)

    2024

  22. [31]

    Bhagubai, M. et al. SeizeIT2, doi:10.18112/openneuro.ds005873.v1.0.0 (2025)

    2025 doi

  23. [32]

    Gorgolewski, K. J. et al. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Sci. Data 3, 10.1038/sdata.2016.44 (2016)

    2016 doi

  24. [33]

    & Harrer, S

    Roy, S., Kiral-Kornek, I. & Harrer, S. Chrononet: A deep recurrent neural network for abnormal eeg identification (2018). 1802.00308

    2018 arXiv

  25. [34]

    Prevalence of Epilepsy and Sleep Disturbances in Alzheimer Disease

    Shah, V ., Golmohammadi, M., Obeid, I. & Picone, J.Objective Evaluation Metrics for Automatic Classification of EEG Events, 223–255 (Springer International Publishing, Cham, 2021). Acknowledgements We would like to acknowledge all clinicians who were involved in gathering the ...

    2021

Pith tools

Reviewed August 9, 2026 · model on record in the stance chip above.