Pith. sign in

REVIEW 5 major objections 8 minor 72 references

UL-DD: A Multimodal Drowsiness Dataset Using Video, Biometric Signals, and Behavioral Data

T0 review · 5 major / 8 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read UL-DD is a public multimodal dataset that records driver drowsiness as a gradual 9-level process through continuous 40-minute sessions with synchronized video, biometric, and behavioral signals.

desk verdict A potentially useful multimodal drowsiness dataset whose core gradual-change claim is not yet supported by the reported validation. read the letter →

arxiv 2507.13403 v1 pith:LFH44W6I submitted 2025-07-16 cs.CV cs.LG

Morteza Bodaghi , Majid Hosseini , Raju Gottumukkala , Ravi Teja Bhupatiraju , Iftikhar Ahmad , Moncef Gabbouj This is my paper · ORCID
classification cs.CVcs.LG
keywords multimodaldriverdrowsinessdatasetbehavioranalysiscontinuousbiosignalsdetectiondepthcamerabiometricsignalssteeringtelemetryearlyfatigueandopen-access
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper introduces UL-DD, a public dataset built to record driver drowsiness as a gradual process rather than a binary awake-or-asleep state. It claims that two 40-minute driving-simulator sessions per subject, one started while alert and one started with a Karolinska Sleepiness Scale (KSS) score of at least 6, yield self-reported KSS ratings every four minutes that trace slow transitions across a 9-level scale. The dataset bundles synchronized streams from three video cameras, two wrist-worn sensor bands, steering-wheel grip pressure sensors, and simulator telemetry, together with extracted facial landmarks, facial action units, and pose landmarks. If the claims hold, researchers gain a public benchmark for early and fine-grained drowsiness detection, in contrast to existing public datasets that mostly offer short clips, single modalities, or coarse alert/sleepy classes.

What carries the argument

The carrying object is the dataset itself, specifically its session design: each subject drives a simulated truck for two 40-minute sessions, one from an alert state and one from a KSS ≥ 6 sleepy state, and reports KSS every four minutes to produce ten ordinal labels per session. That design is what allows the paper to claim gradual, 9-level state trajectories instead of discrete alert/drowsy categories. Around it are the synchronized multimodal streams—three video cameras, two wristbands, grip-pressure sensors, and 60 Hz simulator telemetry—and the machine-extracted intermediate features (68 facial landmarks, 30 facial action units, 33 pose landmarks) that let researchers work with the data even when raw video is withheld.

What would settle it

Compute the ten per-session KSS ratings for every subject: if most awake sessions stay below 4 and most drowsy sessions stay above 6, with few intermediate labels, the gradual-change claim fails. A second check is the expert-rated third of the videos: the reported unweighted κ of 0.619 on the 9-level scale means the disagreement pattern should be inspected to see whether errors concentrate at middle levels, which would weaken the ordinal labels.

Watch

Extended reading notes

Core claim

The central claim is that UL-DD is a multimodal driver-drowsiness resource that captures gradual changes in driver state through continuous 40-minute recording sessions and 9-level KSS annotations. The authors report collecting two sessions per subject (19 subjects total, with 16 completing both sessions), one when the subject was alert and one when the KSS score was at least 6, with self-reports every four minutes during active driving. The dataset combines three video streams, physiological signals from two wrist-worn sensors, grip pressure from both sides of the steering wheel, and simulator telemetry, with all streams temporally aligned to manual session start and end times. The paper further reports technical validation: most biometric signals differ significantly across binned drowsiness levels in mixed-effects models (BVP is the main exception), inter-rater agreement with an expert on the 9-level scale is high when quadratically weighted (κ = 0.967), and an early-fusion model using biometric, behavioral, and facial features reached 84% accuracy in three-level drowsiness classification.

Load-bearing premise

The whole dataset's value as a gradual-drowsiness resource depends on the assumption that the KSS ratings participants gave every four minutes were truthful, self-aware, and spread across the scale within each session rather than clustering into one alert block and one sleepy block.

Editorial extensions

If this is right

  • Models trained on UL-DD can be evaluated on 9-level ordinal labels rather than binary alert/sleepy decisions, a direct consequence of the annotation scheme.
  • In the paper's validation, combining biometric, behavioral, and facial features with early fusion reached 84% accuracy for three-level drowsiness classification, above every individual modality, supporting multimodal fusion as the route to better detection.
  • Because extracted facial landmarks, action units, and pose landmarks are provided for all subjects, feature-based models can be built and compared even for the subjects whose raw video was withheld.
  • The per-subject, per-session folder structure with manually synchronized start and end times makes it possible to reproduce the fusion pipeline and to study within-session temporal dynamics at 4 Hz resampling.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial inference: if the KSS trajectories within a session do vary gradually, the dataset could support predicting time-to-drowsiness-onset or continuous alertness scores, tasks that binary benchmarks cannot address.
  • Editorial inference: the four-minute KSS prompts may themselves briefly raise arousal (for example in EDA or heart rate), so analyses should test for prompt-locked artifacts before treating the physiological signals as purely drowsiness-driven.
  • Editorial inference: the mixed-effects results in Table 5, where BVP showed no significant drowsiness association and HR did not separate medium from high drowsiness, suggest that pulse rate is the more reliable cardiac index and that modality-fusion weights should reflect that.
  • Editorial inference: a natural extension is to benchmark models that predict all 9 KSS levels directly and compare their error structure with the 3-level validation reported here; this would reveal whether the intermediate labels carry usable signal.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 8 minor

Summary. This paper introduces UL-DD, a multimodal driver drowsiness dataset collected from 19 participants in a fixed-base driving simulator. Each participant was recorded in up to two 40-minute sessions (one alert, one drowsy), with three video streams (ZED 2 depth, IR, and webcam pose), wrist-worn biometrics (Empatica E4: HR, EDA, TEMP, ACC, BVP, IBI; Checkme O2: SpO2, pulse rate, motion), steering-wheel grip pressure, driving telemetry from American Truck Simulator, and derived facial landmarks, facial action units, and pose landmarks. Drowsiness was self-reported with the 9-level Karolinska Sleepiness Scale every four minutes, yielding ten interval labels per session. The technical validation includes SNR analysis, Kruskal-Wallis and mixed-effects tests on biometric signals, inter-rater Kappa, and SVM/Random Forest classification with 5-fold cross-validation. The authors argue that continuous 40-minute sessions and 9-level KSS annotations distinguish UL-DD from existing public drowsiness datasets.

Significance. If the dataset is delivered as described, it is a potentially valuable addition to the field: few public resources combine depth/IR/pose video with wrist-based physiological signals, grip pressure, and simulator telemetry, and the explicit 40-minute continuous sessions are longer than many comparable benchmarks such as DROZY or RLDD. The paper's strengths include clear documentation of the sensor setup, the provision of derived landmark and action-unit features, and a stated intention to release code and tutorials. The main caveat is that the paper's novelty rests on the claim of gradual, 9-level changes in drowsiness, and the reported validity evidence does not yet substantiate that claim; in addition, the classification validation does not demonstrate subject-independent generalization. These issues are addressable with additional analyses and reporting.

major comments (5)
  1. [Sections 3.6, 3.7, and Table 4] The central claim of gradual within-session drowsiness change is not supported by any reported label distribution. Since each subject has only two sessions (one begun alert, one begun at KSS >= 6) and labels are collected every four minutes, the ten KSS values per session could be two nearly homogeneous blocks. Please report per-subject, per-session KSS trajectories, the frequency of each KSS level, and the number of within-session transitions; without this, the 'gradual changes' and '9-level' novelty is unverified.
  2. [Section 3.7] Cronbach's alpha of 0.99 is not an appropriate reliability measure here. Alpha estimates internal consistency among items of a multi-item scale; applying it to ten repeated single-item KSS assessments simply shows that ratings are consistent across time points and is compatible with two constant blocks. Replace this with appropriate analyses such as within-session variance, transition matrices, or test-retest reliability, and do not claim that alpha demonstrates gradual change.
  3. [Section 6.4 and Figure 8] The 5-fold cross-validation is ambiguous with respect to subject independence. The text says that raw data from all subjects and sessions were combined before splitting and that folds were 'stratified to maintain the distribution of drowsiness levels across subjects,' which suggests that intervals from the same subject can appear in both training and test folds. If so, the reported accuracies (63-84%) include subject leakage. Please clarify the split at the subject level or rerun the experiments with leave-subjects-out evaluation.
  4. [Section 6.3] The inter-rater results do not establish that 9-level KSS labels are reliable. Unweighted kappa of 0.619 for the full scale is only 'substantial' agreement, and the quadratic-weighted kappa of 0.967 is expected to be high given the ordinal structure, even when raters differ by one or two levels. Report the full confusion or disagreement matrix between experts and self-reports, per-level agreement, and agreement for the 3-level binning separately, and discuss whether the fine 9-level distinctions are trustworthy.
  5. [Section 6.4 and Figure 8] The validation reports only point accuracy without error bars, class distribution, a majority-class baseline, or a chance level. For a three-class problem with possibly imbalanced labels, 63% telemetry accuracy and 80-84% multimodal accuracy are not interpretable without these. Please add confidence intervals, a no-signal baseline such as majority-class prediction, and per-class precision and recall.
minor comments (8)
  1. [Section 4.1] The file format descriptions are inconsistent: 'User FL Session.csv' says 136 columns for 68 landmarks plus 'the frame number recorded in the first column,' making 137 columns; likewise, PL (99 + 1) and FAU (30 + 1) need the column counts clarified.
  2. [Section 3.2.2 and Section 3.2.1] The IR camera is described as '1080p' but listed at 640x360 at 60 fps, and the ZED 2 camera is listed at 1344x376 at 60 fps, which is not a standard ZED 2 mode; specify the original and processed resolutions and any cropping or resizing steps.
  3. [Section 4.1] The BVP bullet says 'The TEMP signal was recorded at a frequency of 4 Hz,' which appears to be a copy-paste error, and the Empatica E4's BVP sample rate is typically 64 Hz; verify and correct the stated frequency.
  4. [Table 5] The dummy coding (reference level) for the Low/Medium/High bins is not defined, so the signs of T.Low and T.Med cannot be interpreted; state the reference category and reconcile the text's claim that 'EDA decreased with increased drowsiness' with the table's coefficients.
  5. [Section 6.1.1] The reporting of non-significant tests is incomplete: the text mentions only 'ACC X' for the Medium-vs-High comparison, and BVP is excluded for Low-vs-High; list the full set of signals and p-values so readers can see which signals failed to reach significance.
  6. [Section 6.4] Downsampling all modalities to 4 Hz is applied without justification; for telemetry (60 Hz) and landmark streams (60 fps), this may discard saccadic or steering micro-correction information, so please state why 4 Hz is appropriate or provide a sensitivity analysis.
  7. [Sections 7 and 8] The paper says the dataset is 'available upon request' but also that 'Readers can access all the code and tutorials along with the dataset'; clarify the exact access mechanism, repository URL, and any usage agreement.
  8. [Table 1] The 'No of Classes' column lists UL-DD as 9, while the validation experiments use 3-level bins; clarify how the labels are provided in the dataset and how users should treat the 9-level labels relative to the binned evaluation.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the dataset's contribution is the collected multimodal data itself, and its internal validation experiments do not reduce to their own inputs.

full rationale

UL-DD is a dataset paper, not a derivation of a predicted quantity from fitted parameters. The central claim is the existence and composition of a new multimodal drowsiness dataset (Abstract; Sections 3 and 4). The KSS self-report labels are collected independently of the physiological, video, and behavioral streams, so there is no self-definitional reduction: drowsiness level is not defined in terms of the signals, and the signals are not defined in terms of the KSS score. Section 6.1 tests whether biometric signals differ across KSS-derived Low/Medium/High bins; this is an empirical association check, not a fitted input renamed as a prediction. Section 6.3 compares expert KSS ratings to participant self-reports using Cohen's Kappa; this measures label consistency and does not reduce to the dataset's own construction. Section 6.4 reports classification accuracies with 5-fold cross-validation on the same dataset; this is an internal sanity check for the dataset's usability, not an external prediction claim whose outcome is forced by a fitted parameter. The self-citations [53], [54], and [55] appear only as methodological pointers in suggested feature-extraction and fusion discussions (Sections 5.1.1 and 5.1.3); none is load-bearing for the dataset's validity or novelty. The paper's own limitation section (Section 9) acknowledges the small, gender-unbalanced sample and simulator environment. Concerns about whether KSS self-reports truly capture gradual within-session change, or whether unweighted Kappa = 0.619 supports fine-grained 9-level labels, are empirical validity questions, not circularity. No equation or claimed result is equivalent to its own input by construction, so the circularity score is 0.

Assumptions & free parameters 3 free parameters · 5 assumptions · 0 invented entities

The main burden of the central claim rests on the validity of KSS self-reports and the assumption that the two-session protocol captures gradual state changes. The statistical validation relies on standard but partly violated independence assumptions. No new entities are introduced; the contributions are data and extracted features.

free parameters (3)
  • KSS binning thresholds for Low/Medium/High = Low < 4, Medium 4-6, High > 6
    Hand-chosen cutoffs used for statistical tests and classification validation (Sections 6.1, 6.4).
  • SNR low-pass filter cutoff frequencies = 1.5 Hz for HR, SpO2, pulse rate, EDA; 1.0 Hz for TEMP, ACC, grip pressure
    Chosen to preserve signal components; affects SNR quality estimates in Section 6.2.
  • Resampling frequency for multimodal fusion = 4 Hz
    Chosen in Section 6.4 to align all modalities for classification; no sensitivity analysis provided.
assumptions (5)
  • domain assumption Self-reported Karolinska Sleepiness Scale is a valid and reliable measure of drowsiness
    Underlies all labels; invoked in Sections 3.6-3.7 and 6.3.
  • domain assumption Participants accurately report their state and follow the protocol (abstinence from caffeine, etc.)
    Relies on participant compliance; Section 3.1.
  • domain assumption The driving simulator induces realistic drowsiness comparable to real driving
    The authors note simulator vs real-world limitation in Section 9.
  • domain assumption Dlib and MediaPipe produce accurate facial and pose landmarks
    Used for FAU/PL extraction (Sections 3.3, 3.5).
  • standard math Independence assumptions of Kruskal-Wallis tests
    Repeated measures within subjects violate independence; mixed-effects model partially addresses this, but Kruskal-Wallis results in Section 6.1.1 treat observations as independent.

how reviews work

0 comments
Cite this review

Pith. "Pith review of UL-DD: A Multimodal Drowsiness Dataset Using Video, Biometric Signals, and Behavioral Data." pith.science (2026). https://pith.science/paper/LFH44W6I

@misc{pith2026250713403,
  author       = {Pith},
  title        = {Pith review of: UL-DD: A Multimodal Drowsiness Dataset Using Video, Biometric Signals, and Behavioral Data},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LFH44W6I}},
  note         = {Machine review of arXiv:2507.13403}
}
read the original abstract

In this study, we present a comprehensive public dataset for driver drowsiness detection, integrating multimodal signals of facial, behavioral, and biometric indicators. Our dataset includes 3D facial video using a depth camera, IR camera footage, posterior videos, and biometric signals such as heart rate, electrodermal activity, blood oxygen saturation, skin temperature, and accelerometer data. This data set provides grip sensor data from the steering wheel and telemetry data from the American truck simulator game to provide more information about drivers' behavior while they are alert and drowsy. Drowsiness levels were self-reported every four minutes using the Karolinska Sleepiness Scale (KSS). The simulation environment consists of three monitor setups, and the driving condition is completely like a car. Data were collected from 19 subjects (15 M, 4 F) in two conditions: when they were fully alert and when they exhibited signs of sleepiness. Unlike other datasets, our multimodal dataset has a continuous duration of 40 minutes for each data collection session per subject, contributing to a total length of 1,400 minutes, and we recorded gradual changes in the driver state rather than discrete alert/drowsy labels. This study aims to create a comprehensive multimodal dataset of driver drowsiness that captures a wider range of physiological, behavioral, and driving-related signals. The dataset will be available upon request to the corresponding author.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

72 extracted references · 70 canonical work pages

  1. [1]

    IEEE vehicular technology magazine 12(4), 69–76 (2017)

    Magana, V.C., Munoz-Organero, M.: Toward safer highways: predicting driver stress in varying conditions on habitual routes. IEEE vehicular technology magazine 12(4), 69–76 (2017)

    work page 2017

  2. [2]

    In: Computer Vision–ACCV 2016 Workshops: ACCV 2016 International Workshops, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part III 13, pp

    Weng, C.-H., Lai, Y.-H., Lai, S.-H.: Driver drowsiness detection via a hierarchi- cal temporal deep belief network. In: Computer Vision–ACCV 2016 Workshops: ACCV 2016 International Workshops, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part III 13, pp. 117–133 (2017). Springer

    work page 2017

  3. [3]

    In: 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp

    Salzillo, G., Natale, C., Fioccola, G.B., Landolfi, E.: Evaluation of driver drowsi- ness based on real-time face analysis. In: 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 328–335 (2020). IEEE

    work page 2020

  4. [4]

    In: 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp

    Hwang, T., Kim, M., Hong, S., Park, K.S.: Driver drowsiness detection using the in-ear eeg. In: 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4646–4649 (2016). IEEE

    work page 2016

  5. [5]

    In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp

    Massoz, Q., Langohr, T., Fran¸ cois, C., Verly, J.G.: The ulg multimodality drowsiness database (called drozy) and examples of use. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–7 (2016). IEEE

    work page 2016

  6. [6]

    Journal of neural engineering 14(2), 026017 (2017)

    Zheng, W.-L., Lu, B.-L.: A multimodal approach to estimating vigilance using eeg and forehead eog. Journal of neural engineering 14(2), 026017 (2017)

    work page 2017

  7. [7]

    Biomedical Signal Processing and Control 70, 103023 (2021)

    Shen, M., Zou, B., Li, X., Zheng, Y., Li, L., Zhang, L.: Multi-source signal alignment and efficient multi-dimensional feature classification in the applica- tion of eeg-based subject-independent drowsiness detection. Biomedical Signal Processing and Control 70, 103023 (2021)

    work page 2021

  8. [8]

    : Automotive: a case study on automatic multimodal drowsiness detection for smart vehicles

    Esteves, T., Pinto, J.R., Ferreira, P.M., Costa, P.A., Rodrigues, L.A., Antunes, I., Lopes, G., Gamito, P., Abrantes, A.J., Jorge, P.M., et al. : Automotive: a case study on automatic multimodal drowsiness detection for smart vehicles. IEEE Access 9, 153678–153700 (2021)

    work page 2021

Show all 72 references
  1. [9]

    Schleicher, R., Galley, N., Briest, S., Galley, L.: Blinks and saccades as indica- tors of fatigue in sleepiness warnings: looking tired? Ergonomics 51(7), 982–1010 (2008)

    2008

  2. [10]

    In: Proceedings of the Ieee/cvf 23 Conference on Computer Vision and Pattern Recognition Workshops, pp

    Ghoddoosian, R., Galib, M., Athitsos, V.: A realistic dataset and baseline tem- poral model for early drowsiness detection. In: Proceedings of the Ieee/cvf 23 Conference on Computer Vision and Pattern Recognition Workshops, pp. 0–0 (2019)

    2019

  3. [11]

    In: Proceedings of the 5th ACM Multimedia Systems Conference, pp

    Abtahi, S., Omidyeganeh, M., Shirmohammadi, S., Hariri, B.: Yawdd: A yawn- ing detection dataset. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 24–28 (2014)

    2014

  4. [12]

    IEEE transactions on intelligent transportation systems 21(1), 346– 361 (2019)

    Chiou, C.-Y., Wang, W.-C., Lu, S.-C., Huang, C.-R., Chung, P.-C., Lai, Y.- Y.: Driver monitoring using sparse representation with part-based temporal face descriptors. IEEE transactions on intelligent transportation systems 21(1), 346– 361 (2019)

    2019

  5. [13]

    In: Conference of Open Innovations Association (FRUCT), vol

    Yılmaz, E.K., Akcayol, M.A.: Sust-ddd: A real-drive dataset for driver drowsi- ness detection. In: Conference of Open Innovations Association (FRUCT), vol. 6 (2022)

    2022

  6. [14]

    Signal Processing: Image Communication 88, 115960 (2020)

    Jegham, I., Khalifa, A.B., Alouani, I., Mahjoub, M.A.: A novel public dataset for multimodal multiview and multispectral driver distraction analysis: 3mdad. Signal Processing: Image Communication 88, 115960 (2020)

    2020

  7. [15]

    In: Advances in Visual Computing: 13th International Symposium, ISVC 2018, Las Vegas, NV, USA, November 19–21, 2018, Proceedings 13, pp

    Fusek, R.: Pupil localization using geodesic distance. In: Advances in Visual Computing: 13th International Symposium, ISVC 2018, Las Vegas, NV, USA, November 19–21, 2018, Proceedings 13, pp. 433–444 (2018). Springer

    2018

  8. [16]

    In: 2023 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp

    Nuralif, I., Yuniarno, E.M., Suprapto, Y.K., Wicaksono, A.A.: Driver fatigue detection based on face mesh features using deep learning. In: 2023 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp. 1–5 (2023). IEEE

    2023

  9. [17]

    In: 2019 IEEE Intelligent Vehicles Symposium (IV), pp

    Roth, M., Gavrila, D.M.: Dd-pose-a large-scale driver head pose benchmark. In: 2019 IEEE Intelligent Vehicles Symposium (IV), pp. 927–934 (2019). IEEE

    2019

  10. [18]

    In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp

    Ohn-Bar, E., Trivedi, M.: The power is in your hands: 3d analysis of hand gestures in naturalistic video. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 912–917 (2013)

    2013

  11. [19]

    In: 2018 Interna- tional Conference on Information and Communication Technology Convergence (ICTC), pp

    Choi, H.-T., Back, M.-K., Lee, K.-C.: Driver drowsiness detection based on multimodal using fusion of visual-feature and bio-signal. In: 2018 Interna- tional Conference on Information and Communication Technology Convergence (ICTC), pp. 1249–1251 (2018). IEEE

    2018

  12. [20]

    In: 2010 IEEE Intelligent Vehicles Symposium, pp

    Friedrichs, F., Yang, B.: Camera-based drowsiness reference for driver state classification under real driving conditions. In: 2010 IEEE Intelligent Vehicles Symposium, pp. 101–106 (2010). IEEE

    2010

  13. [21]

    arXiv preprint 24 arXiv:2104.00125 (2021)

    Faraji, F., Lotfi, F., Khorramdel, J., Najafi, A., Ghaffari, A.: Drowsiness detection based on driver temporal behavior using a new developed dataset. arXiv preprint 24 arXiv:2104.00125 (2021)

    2021 arXiv

  14. [22]

    IEEE Transactions on Intelligent Transportation Systems (2024)

    Yang, L., Yang, H., Wei, H., Hu, Z., Lv, C.: Video-based driver drowsiness detection with optimised utilization of key facial features. IEEE Transactions on Intelligent Transportation Systems (2024)

    2024

  15. [23]

    In: Computer Vision–ECCV 2020 Workshops: Glasgow, UK, August 23–28, 2020, Proceedings, Part IV 16, pp

    Ortega, J.D., Kose, N., Ca˜ nas, P., Chao, M.-A., Unnervik, A., Nieto, M., Otaegui, O., Salgado, L.: Dmd: A large-scale multi-modal driver monitoring dataset for attention and alertness analysis. In: Computer Vision–ECCV 2020 Workshops: Glasgow, UK, August 23–28, 2020, Proceed...

    2020

  16. [24]

    In: Proceedings of the 2021 International Conference on Multimodal Interaction, pp

    Das, K., Sharak, S., Riani, K., Abouelenien, M., Burzo, M., Papakostas, M.: Multimodal detection of drivers drowsiness and distraction. In: Proceedings of the 2021 International Conference on Multimodal Interaction, pp. 416–424 (2021)

    2021

  17. [25]

    IEEE Sensors Journal 23(3), 2592–2604 (2022)

    Guo, Z., Zhou, M., Li, G.: Driver vigilance state estimation based on multisource data. IEEE Sensors Journal 23(3), 2592–2604 (2022)

    2022

  18. [26]

    Biomedical Signal Processing and Control 84, 104744 (2023)

    Shi, J., Wang, K.: Fatigue driving detection method based on time-space- frequency features of multimodal signals. Biomedical Signal Processing and Control 84, 104744 (2023)

    2023

  19. [27]

    In: International Conference on Pervasive Computing Technologies for Healthcare, pp

    Kalanadhabhatta, M., Min, C., Montanari, A., Kawsar, F.: Fatigueset: A multi- modal dataset for modeling mental fatigue and fatigability. In: International Conference on Pervasive Computing Technologies for Healthcare, pp. 204–217 (2021). Springer

    2021

  20. [28]

    IEEE Transactions on Affective Computing 14(2), 1334–1350 (2021)

    Stappen, L., Baird, A., Schumann, L., Schuller, B.: The multimodal sentiment analysis in car reviews (muse-car) dataset: Collection, insights and improvements. IEEE Transactions on Affective Computing 14(2), 1334–1350 (2021)

    2021

  21. [29]

    Scientific data 11(1), 378 (2024)

    Tao, X., Gao, D., Zhang, W., Liu, T., Du, B., Zhang, S., Qin, Y.: A multimodal physiological dataset for driving behaviour analysis. Scientific data 11(1), 378 (2024)

    2024

  22. [30]

    Frontiers in psychology 11, 920 (2020)

    Clark, E.A., Kessinger, J., Duncan, S.E., Bell, M.A., Lahne, J., Gallagher, D.L., O’Keefe, S.F.: The facial action coding system for characterization of human affective response to consumer product-based stimuli: a systematic review. Frontiers in psychology 11, 920 (2020)

    2020

  23. [31]

    Medical & biological engineering & computing 54, 927–937 (2016)

    Vicente, J., Laguna, P., Bartra, A., Bail´ on, R.: Drowsiness detection using heart rate variability. Medical & biological engineering & computing 54, 927–937 (2016)

    2016

  24. [32]

    Physiology & behavior 90(2-3), 25 257–266 (2007)

    Raymann, R.J., Swaab, D.F., Van Someren, E.J.: Skin temperature and sleep- onset latency: changes with age and insomnia. Physiology & behavior 90(2-3), 25 257–266 (2007)

    2007

  25. [33]

    Sensors 22(19), 7639 (2022)

    Dolson, C.M., Harlow, E.R., Phelan, D.M., Gabbett, T.J., Gaal, B., McMellen, C., Geletka, B.J., Calcei, J.G., Voos, J.E., Seshadri, D.R.: Wearable sensor tech- nology to predict core body temperature: A systematic review. Sensors 22(19), 7639 (2022)

    2022

  26. [34]

    IEEE sensors Journal 18(8), 3055–3067 (2018)

    Chowdhury, A., Shankaran, R., Kavakli, M., Haque, M.M.: Sensor applica- tions and physiological features in drivers’ drowsiness detection: A review. IEEE sensors Journal 18(8), 3055–3067 (2018)

    2018

  27. [35]

    IEEE Transactions on Intelligent Transportation Systems 25(6), 5510–5524 (2023)

    Jiao, Y., Zhang, C., Chen, X., Fu, L., Jiang, C., Wen, C.: Driver fatigue detec- tion using measures of heart rate variability and electrodermal activity. IEEE Transactions on Intelligent Transportation Systems 25(6), 5510–5524 (2023)

    2023

  28. [36]

    IEEE communications surveys & tutorials 15(3), 1192–1209 (2012)

    Lara, O.D., Labrador, M.A.: A survey on human activity recognition using wearable sensors. IEEE communications surveys & tutorials 15(3), 1192–1209 (2012)

    2012

  29. [37]

    Cognitive neurodynamics 17(5), 1229–1259 (2023)

    Saleem, A.A., Siddiqui, H.U.R., Raza, M.A., Rustam, F., Dudley, S., Ashraf, I.: A systematic review of physiological signals based driver drowsiness detection systems. Cognitive neurodynamics 17(5), 1229–1259 (2023)

    2023

  30. [38]

    Traffic injury prevention 19(sup1), 112–119 (2018)

    Forcolin, F., Buendia, R., Candefjord, S., Karlsson, J., Sj¨ oqvist, B.A., Anund, A.: Comparison of outlier heartbeat identification and spectral transformation strategies for deriving heart rate variability indices for drivers at different stages of sleepiness. Traffic injury...

    2018

  31. [39]

    In: 2014 IEEE International Sym- posium on Medical Measurements and Applications (MeMeA), pp

    Clarke, G.W., Chan, A.D., Adler, A.: Effects of motion artifact on the blood oxygen saturation estimate in pulse oximetry. In: 2014 IEEE International Sym- posium on Medical Measurements and Applications (MeMeA), pp. 1–4 (2014). IEEE

    2014

  32. [40]

    Journal of applied physiology 99(5), 2036– 2044 (2005)

    Thomson, S., Morrell, M.J., Cordingley, J.J., Semple, S.J.: Ventilation is unstable during drowsiness before sleep onset. Journal of applied physiology 99(5), 2036– 2044 (2005)

    2005

  33. [41]

    IEEE transactions on intelligent transportation systems 12(2), 596–614 (2010)

    Dong, Y., Hu, Z., Uchimura, K., Murayama, N.: Driver inattention monitor- ing system for intelligent vehicles: A review. IEEE transactions on intelligent transportation systems 12(2), 596–614 (2010)

    2010

  34. [42]

    arXiv preprint arXiv:1906.08172 (2019)

    Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.-L., Yong, M.G., Lee, J., et al.: Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172 (2019)

    2019 arXiv

  35. [43]

    IEEE Access (2024) 26

    Mahomed, A.S., Saha, A.K.: Driver posture recognition: A review. IEEE Access (2024) 26

    2024

  36. [44]

    International Journal of Contents 12(1), 44–48 (2016)

    LEE, K., HYUN, S.-A., Oah, S.: Detecting driver fatigue by steering wheel grip force. International Journal of Contents 12(1), 44–48 (2016)

    2016

  37. [45]

    Sleep 24(6), 695–698 (2001)

    Baulk, S.D., Reyner, L., Horne, J.A.: Driver sleepiness—evaluation of reaction time measurement as a secondary task. Sleep 24(6), 695–698 (2001)

    2001

  38. [46]

    International journal of neuroscience 52(1-2), 29–37 (1990)

    ˚Akerstedt, T., Gillberg, M.: Subjective and objective sleepiness in the active individual. International journal of neuroscience 52(1-2), 29–37 (1990)

    1990

  39. [47]

    International journal of medical education 2, 53 (2011)

    Tavakol, M., Dennick, R.: Making sense of cronbach’s alpha. International journal of medical education 2, 53 (2011)

    2011

  40. [48]

    The Journal of Machine Learning Research 10, 1755–1758 (2009)

    King, D.E.: Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research 10, 1755–1758 (2009)

    2009

  41. [49]

    Neuroscience Research 203, 1–7 (2024)

    Iwama, S., Takemi, M., Eguchi, R., Hirose, R., Morishige, M., Ushiba, J.: Two common issues in synchronized multimodal recordings with eeg: Jitter and latency. Neuroscience Research 203, 1–7 (2024)

    2024

  42. [50]

    Measuring Behavior 2020-21 Volume 1, 26–32 (2020)

    Dolmans, T., Poel, M., Klooster, J., Veldkamp, B.: Data synchronisation and processing in multimodal research. Measuring Behavior 2020-21 Volume 1, 26–32 (2020)

    2020

  43. [51]

    Biological psychology 84(3), 394–421 (2010)

    Kreibig, S.D.: Autonomic nervous system activity in emotion: A review. Biological psychology 84(3), 394–421 (2010)

    2010

  44. [52]

    Ergonomics 61(9), 1259–1272 (2018)

    Zhang, N., Fard, M., Bhuiyan, M., Verhagen, D., Azari, M., Robinson, S.: The effects of physical vibration on heart rate variability as a measure of drowsiness. Ergonomics 61(9), 1259–1272 (2018)

    2018

  45. [53]

    In: 2024 IEEE 3rd Inter- national Conference on Computing and Machine Intelligence (ICMI), pp

    Bodaghi, M., Hosseini, M., Gottumukkala, R.: A multimodal intermediate fusion network with manifold learning for stress detection. In: 2024 IEEE 3rd Inter- national Conference on Computing and Machine Intelligence (ICMI), pp. 1–8 (2024). IEEE

    2024

  46. [54]

    arXiv preprint arXiv:2311.03606 (2023)

    Hosseini, M., Bodaghi, M., Bhupatiraju, R.T., Maida, A., Gottumukkala, R.: Multimodal stress detection using facial landmarks and biometric signals. arXiv preprint arXiv:2311.03606 (2023)

    2023 arXiv

  47. [55]

    Master’s thesis, University of Louisiana at Lafayette (2024)

    Bodaghi, M.: Adaptive attention-based lstm framework for multimodal driver drowsiness prediction. Master’s thesis, University of Louisiana at Lafayette (2024)

    2024

  48. [56]

    IEEE Transactions on Pattern Analysis & Machine Intelligence 43(01), 172–186 (2021)

    Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., Sheikh, Y.: Openpose: Realtime multi-person 2d pose estimation using part affinity fields. IEEE Transactions on Pattern Analysis & Machine Intelligence 43(01), 172–186 (2021)

    2021

  49. [57]

    Sensors 23(3), 1292 (2023)

    Bajaj, J.S., Kumar, N., Kaushal, R.K., Gururaj, H., Flammini, F., Natarajan, 27 R.: System and method for driver drowsiness detection using behavioral and sensor-based physiological measures. Sensors 23(3), 1292 (2023)

    2023

  50. [58]

    IEEE Access 11, 26070–26085 (2023)

    Pourbemany, J., Zhu, Y., Bettati, R.: A survey of wearable devices pairing based on biometric signals. IEEE Access 11, 26070–26085 (2023)

    2023

  51. [59]

    PhD thesis, University of Guelph (2024)

    Zhu, L.: Emotion detection system using electrodermal activity signals from wear- able devices with deep learning techniques. PhD thesis, University of Guelph (2024)

    2024

  52. [60]

    In: Chinese Conference on Pattern Recognition and Computer Vision (PRCV), pp

    Zhang, F., Shao, Y., Sun, Y., Gao, C., Sang, N.: Self-supervised low-light image enhancement via histogram equalization prior. In: Chinese Conference on Pattern Recognition and Computer Vision (PRCV), pp. 63–75 (2023). Springer

    2023

  53. [61]

    IET image processing 15(5), 1189–1202 (2021)

    Yang, J., Xu, Y., Yue, H., Jiang, Z., Li, K.: Low-light image enhancement based on retinex decomposition and adaptive gamma correction. IET image processing 15(5), 1189–1202 (2021)

    2021

  54. [62]

    Image and vision computing 135, 104709 (2023)

    Li, S., Bi, X., Zhao, Y., Bi, H.: Extended neighborhood-based road and median filter for impulse noise removal from depth map. Image and vision computing 135, 104709 (2023)

    2023

  55. [63]

    Statistics and computing 2, 117–119 (1992)

    Royston, P.: Approximating the shapiro-wilk w-test for non-normality. Statistics and computing 2, 117–119 (1992)

    1992

  56. [64]

    The corsini encyclopedia of psychology, 1–1 (2010)

    McKight, P.E., Najab, J.: Kruskal-wallis test. The corsini encyclopedia of psychology, 1–1 (2010)

    2010

  57. [65]

    Springer, ??? (2006)

    Pinheiro, J., Bates, D.: Mixed-effects Models in S and S-PLUS. Springer, ??? (2006)

    2006

  58. [66]

    Neuropsychopharmacology 25(1), 92–96 (2001)

    Kr¨ auchi, K., Wirz-Justice, A.: Circadian clues to sleep onset mechanisms. Neuropsychopharmacology 25(1), 92–96 (2001)

    2001

  59. [67]

    Journal of Clinical Sleep Medicine 19(7), 1281–1292 (2023)

    Tai, Y., Obayashi, K., Yamagami, Y., Saeki, K.: Association between circadian skin temperature rhythms and actigraphic sleep measures in real-life settings. Journal of Clinical Sleep Medicine 19(7), 1281–1292 (2023)

    2023

  60. [68]

    Handbook of clinical neurology 156, 341–351 (2018)

    Szymusiak, R.: Body temperature and sleep. Handbook of clinical neurology 156, 341–351 (2018)

    2018

  61. [69]

    Scientific Data 11(1), 847 (2024)

    Yang, P., Liu, N., Liu, X., Shu, Y., Ji, W., Ren, Z., Sheng, J., Yu, M., Yi, R., Zhang, D., et al.: A multimodal dataset for mixed emotion recognition. Scientific Data 11(1), 847 (2024)

    2024

  62. [70]

    In: 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks, pp

    Patterson, J.A., McIlwraith, D.C., Yang, G.-Z.: A flexible, low noise reflective ppg sensor platform for ear-worn heart rate monitoring. In: 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks, pp. 286–291 28 (2009). IEEE

    2009

  63. [71]

    Sensors 20(2), 479 (2020)

    Posada-Quintero, H.F., Chon, K.H.: Innovations in electrodermal activity data collection and signal processing: A systematic review. Sensors 20(2), 479 (2020)

    2020

  64. [72]

    Journal of Biomechanics 119, 110323 (2021) 29

    Day, E.M., Alcantara, R.S., McGeehan, M.A., Grabowski, A.M., Hahn, M.E.: Low-pass filter cutoff frequency affects sacral-mounted inertial measurement unit estimations of peak vertical ground reaction force and contact time during treadmill running. Journal of Biomechanics 119,...

    2021

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.