Towards Effective Human Performance in XR Space Framework based on Real-time Eye Tracking Biofeedback

Adam Kuzdrali\'nski; Barbara Karpowicz; Grzegorz Marcin W\'ojcik; Pavlo Zinevych; Tomasz Kowalewski; Wies{\l}aw Kope\'c

REVIEW 2 major objections 6 minor 13 references

Towards Effective Human Performance in XR Space Framework based on Real-time Eye Tracking Biofeedback

T0 review · 2 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper proposes a real-time eye-tracking module that would let XR systems adjust task difficulty to the user's gaze-based state.

desk verdict A clearly written design sketch for an XR eye-tracking DDA pipeline that is honest about its own preliminary status, but its central performance claim currently rests on an unvalidated event-classification threshold. read the letter →

arxiv 2507.21000 v1 pith:BR3JUAMT submitted 2025-07-28 cs.HC

Barbara Karpowicz , Tomasz Kowalewski , Pavlo Zinevych , Adam Kuzdraliński , Grzegorz Marcin Wójcik , Wies{l}aw Kopeć This is my paper · ORCID

classification cs.HC

keywords ImmersiveSystemsVirtualRealityeXtendedHumanPerformancePsychophysiologyEyetrackingDynamicDifficultyAdjustmentBiofeedback

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper proposes an eye-tracking module for the XR Space Framework that would let immersive applications read attention, cognitive load, and engagement in real time from gaze data, and act on that state. The intended payoff is dynamic difficulty adjustment in XR-based training, screening, and teleoperation, keeping users in a flow state rather than bored or overwhelmed. The proposal covers a hardware-agnostic pipeline that detects saccades and fixations with velocity thresholds, monitors pupil diameter as an indicator of cognitive load, and runs the heavy data stages off the render thread. If the module performs as described, eye tracking would shift from a post-hoc measurement tool to a live control input for adaptive immersive systems.

What carries the argument

The central mechanism is velocity-threshold identification, a method that computes the angular velocity of gaze from the angle between successive normalized gaze-direction vectors (Equations 1–3) and labels each sample a saccade above 250 deg/s or a fixation below 3 deg/s; pupil-diameter changes are tracked alongside as a cognitive-load signal. This event classification is what feeds the dynamic difficulty adjustment. Equally load-bearing is the module's abstraction layer, which defines abstract classes and interfaces so that the same pipeline can consume eye-tracking data from various HMDs and SDKs, with pupil-based metrics enabled only when the hardware provides them.

What would settle it

Run a controlled training scenario in a head-mounted display comparing task performance and self-reported engagement with dynamic difficulty adjustment driven by this eye-tracking module against a fixed-difficulty control; a second, more direct test is to record gaze in a moving three-dimensional scene with ground-truth saccade and fixation labels from a high-speed reference tracker and measure whether the velocity-threshold classifier keeps its accuracy when the scene moves.

Watch

Extended reading notes

Core claim

The paper's central claim is that a modular eye-tracking pipeline, integrated with a real-time XR engine, can supply continuous, low-latency indicators of attention and cognitive load that are suitable for driving dynamic difficulty adjustment in immersive training, screening, and teleoperation. The proposed module classifies saccades and fixations from gaze-direction angular velocity using threshold rules, monitors pupil diameter as a cognitive-load proxy, and packages the processing in an abstraction layer that accepts data from different eye-tracking SDKs. The workflow keeps calibration, acquisition, preprocessing, processing, and adaptation as separate stages, with data-heavy stages running off the main render thread so that real-time performance is preserved.

Load-bearing premise

The load-bearing premise is that the fixed saccade and fixation velocity thresholds of 250 deg/s and 3 deg/s, taken from eye-tracking literature, remain valid inside dynamic head-mounted XR scenes where head movement and moving visuals change gaze patterns; if the thresholds misclassify events there, the inferred attention and cognitive-load metrics, and the difficulty adjustments built on them, become unreliable.

Editorial extensions

If this is right

XR training systems could raise or lower task difficulty mid-session, guided by whether fixations land on task-relevant objects and whether gaze is scanning too quickly.
Screening applications could use dwell time and missed fixations to flag when a user needs more guidance before the difficulty level is increased.
Teleoperation setups could adapt display and control complexity in response to the operator's real-time cognitive load inferred from pupil and gaze metrics.
Because the module is built on abstract classes and interfaces, the same analysis pipeline could be reused with different head-mounted displays and eye-tracking SDKs without redesigning the logic.
Separating acquisition and processing into dedicated threads keeps the adaptation from degrading frame rate in the real-time graphics engine.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The fixed velocity thresholds (250 deg/s and 3 deg/s) are taken from the eye-tracking literature and the paper does not validate them against dynamic head-mounted scenes with moving visuals; an in-situ calibration or trained classifier would be a natural extension before relying on the metrics for difficulty control.
The paper leaves the mapping from gaze metrics to difficulty change qualitative; a concrete scoring rule linking dwell time, saccade velocity, and pupil dilation to difficulty increments would make the biofeedback loop directly testable.
Pupil diameter is affected by scene luminance changes inside a headset, so combining it with the framework's ECG, GSR, and PPG channels could separate cognitive-load effects from light-induced constriction.
A benchmark comparing real-time event detection latency and accuracy against offline analysis of the same logged eye data would show whether the processing pipeline actually keeps pace with the sampling rate.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Karpowicz et al. describes an architectural proposal for integrating real-time eye tracking into their XR Space Framework to drive Dynamic Difficulty Adjustment. It is not a validated system; there is no running implementation, no user study, and no benchmark. The paper's own language is careful, repeatedly saying DDA is for "future adaptive environments," so it does not oversell. What it does well: it gives a clean, readable account of the pipeline (calibration, buffering, preprocessing, event detection, pupillometry, DDA), grounds the metrics in standard literature, and positions the work inside an existing framework with a plausible "universal approach" via abstract classes and interfaces. The equations are standard and correct. That is real value as a design document.

The soft spots are equally clear. The biggest is the one your stress-test flags: the velocity-threshold classification from Section 3.2 assumes static fixed thresholds for saccades (250 deg/s) and fixations (3 deg/s), but in an HMD the eye-in-head signal is contaminated by the vestibulo-ocular reflex during head movement, and smooth pursuit of moving objects easily produces sustained velocities above 3 deg/s without being saccades. Since the inferred attention and cognitive-load metrics depend entirely on this classification, and the paper offers no head-movement compensation or adaptive thresholding, the load-bearing input to the proposed DDA loop is unvalidated in exactly the conditions XR applications create. The paper acknowledges "complex moving visuals" as a challenge but does not address it. That matters, but it is a missing validation issue, not an internal contradiction, because the paper positions itself as a proposal.

Other issues are minor: the "universal" claim is only supported by one SDK implementation and a mention of OpenXR; the multi-threading discussion is unsurprising; and the self-citations to their own prior systems are appropriate for context, not load-bearing. The paper would benefit from at least a proof-of-concept with real data showing the thresholds behave acceptably in head-mounted, moving scenes.

This deserves serious peer review as a design/position paper for a venue that accepts such contributions. An editor should not desk-reject it, but a referee should require either a working prototype with event-classification validation or an explicit narrowing of the claim. I would not cite it as a result, but I would mention it as a roadmap. Worth a reading group if your group works on adaptive XR or physiological sensing.

Referee Report

2 major / 6 minor

Summary. The paper proposes an eye tracking module for the XR Space Framework, intended to provide real-time gaze-based metrics (saccades, fixations, pupil diameter) that feed into Dynamic Difficulty Adjustment (DDA) for XR applications in training, screening, and teleoperation. It describes a workflow spanning calibration, data acquisition, preprocessing, processing, and DDA, and it uses velocity-threshold identification to classify eye movements. The paper includes equations for angular velocity and event classification, a high-level architecture based on abstract classes, and a discussion of threading efficiency. No implementation, empirical data, user study, or real-time performance measurements are presented; the text explicitly places DDA in "the future adaptive environments."

Significance. If fully realized and validated, the proposed module could make a modest but useful contribution by standardizing real-time integration of eye tracking biofeedback into XR frameworks, potentially benefiting adaptive training and teleoperation systems. The paper's strengths are its clear workflow description, use of established velocity-threshold algorithms with citations, and explicit acknowledgment of current limitations. However, the central claim of enhancing human performance is not demonstrated: there is no evidence that the pipeline runs in real time, that the event classifications are accurate in dynamic HMD scenes, or that the inferred attention/cognitive-load metrics lead to correct DDA decisions. The significance is therefore prospective rather than established.

major comments (2)

[3.2, Equations (1)-(3)] The fixed velocity thresholds (saccade above 250 deg/s, fixation below 3 deg/s) are taken from classical eye tracking literature and are applied without modification to HMD-based XR. In dynamic immersive scenes, the vestibulo-ocular reflex rotates the eye relative to the head during natural head movement, and smooth pursuit of moving objects produces sustained eye-in-head velocities that can exceed the fixation threshold and even overlap saccade velocities. The proposed module has no head-movement compensation, no pursuit handling, and no adaptive threshold mechanism, so the saccade/fixation labels and the derived attention/cognitive-load metrics may be unreliable. Because these metrics are the sole inputs to DDA, this unvalidated threshold assumption is load-bearing for the paper's central claim. The authors should describe coordinate-system handling, add support for smooth pursuit and VOR, and provide empirical validation in the target dynamic scenarios.
[3.4, Figure 2] The DDA stage is described only as a future component: the text states that the metrics "can be used for Dynamic Difficulty Adjustment in the future adaptive environments." No implementation details, latency measurements, frame-rate impact data, or user study are reported. Consequently, there is no evidence that the pipeline runs in real time or that the proposed metrics lead to correct difficulty adjustments. To support the title's "Effective Human Performance" claim, the authors would need at least a proof-of-concept implementation with a pilot evaluation, even offline analysis of recorded sessions or a small within-subjects study comparing DDA against fixed-difficulty conditions.

minor comments (6)

[2.1] The heading "Data Aquisition" contains a typo and should read "Data Acquisition."
[3.2] The footnote "Normalize vector has a length 1" is grammatically incorrect; it should be "A normalized vector has length 1."
[3.2] The classification rule divides samples into saccades (above 250 deg/s) and fixations (below 3 deg/s), but leaves the range 3-250 deg/s unclassified; the paper should state how samples in this intermediate range are labeled in the processing pipeline.
[3.1, Table 1] The table lists "Time to first fixation (TTFF)" as a metric, but TTFF does not appear anywhere in the proposed workflow; either remove it or explain how it is integrated into the module.
[3.3] The claim that "developers can easily extend these abstract classes" is not substantiated; providing a minimal interface sketch or a brief example would make the universality claim more concrete.
[References] Reference 1 ("Beck, L.A.") is incomplete and confusingly attributed; the work is Csikszentmihalyi's Flow, and the reference list entry should be corrected to the original source with full bibliographic details.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the eye-tracking module is a design proposal whose thresholds and metrics come from external sources, not from fitting or from self-referential definitions.

full rationale

The paper does not present a derivation that reduces to its own inputs. Equations 1-3 define angular velocity and angle, and the saccade/fixation thresholds (250 deg/s and 3 deg/s) are imported from external eye-tracking literature (citations [3,4]), explicitly flagged as typical rather than fitted. Table 1 maps metrics to engagement and emotional state, but the paper does not perform a validation or prediction step; it describes an operationalization for a proposed DDA pipeline, and Section 3.4 itself frames DDA as future work ('used for Dynamic Difficulty Adjustment in the future adaptive environments'). The self-citations in Section 2 and 2.1 ('In our previous systems, 5-point calibration was used. [5,7,10,11,13]') are background reports of prior data-acquisition systems, not load-bearing justification for the module's validity or for any claimed result. No uniqueness theorem is imported, no parameter is fitted and renamed as a prediction, and no known empirical pattern is repackaged under new coordinates. The main concerns with the paper are external-validity risks (fixed thresholds under head movement, smooth pursuit, and VOR in HMDs), which are not circularity and would be better scored as correctness or validity risk. Therefore no circular step is identified.

Assumptions & free parameters 3 free parameters · 5 assumptions · 0 invented entities

The central claim depends on prior literature for thresholds and on the assumption that eye tracking metrics reflect mental state. No new free parameters are fitted in this paper; the listed thresholds and calibration count are hand-chosen design inputs. The framework also relies on the authors' own prior systems for data acquisition context.

free parameters (3)

Saccade velocity threshold = 250 deg/s
Chosen by hand from cited literature (ref [3]); used to classify saccades and is load-bearing for DDA decisions.
Fixation velocity threshold = 3 deg/s
Chosen by hand from cited literature (ref [3]); used to classify fixations and is load-bearing for DDA decisions.
Eye tracking calibration point count = 5 points
Design choice from the authors' previous systems (refs [5,7,10,11,13]); calibration quality affects all downstream gaze metrics.

assumptions (5)

domain assumption Eye tracking metrics (fixation duration, saccade velocity, pupil dilation, blink rate) index cognitive load and engagement.
Stated in Section 1 and Table 1; the DDA loop depends on this mapping being reliable in XR contexts.
domain assumption Flow Theory and Dynamic Difficulty Adjustment improve user performance and experience.
Invoked in Section 2.2 via references [1] and [2]; the adaptive mechanism is assumed beneficial without direct validation here.
domain assumption Velocity-threshold identification from prior eye tracking literature transfers to real-time HMD-based XR data.
Section 3.2 applies thresholds from [3] to headset gaze data; the abstract notes HMD moving visuals pose unique challenges, so this transfer is assumed rather than tested.
domain assumption SRanipal API and HTC Vive Pro Eye provide reliable real-time gaze and pupil data.
Section 3.3 relies on this hardware/API for acquisition; no accuracy validation is provided in the paper.
standard math Angular velocity between gaze vectors is computable via arccos of the normalized dot product.
Equation 3 in Section 3.2; standard vector geometry, not a domain-specific assumption.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Towards Effective Human Performance in XR Space Framework based on Real-time Eye Tracking Biofeedback." pith.science (2026). https://pith.science/paper/BR3JUAMT

@misc{pith2026250721000,
  author       = {Pith},
  title        = {Pith review of: Towards Effective Human Performance in XR Space Framework based on Real-time Eye Tracking Biofeedback},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/BR3JUAMT}},
  note         = {Machine review of arXiv:2507.21000}
}

read the original abstract

This paper proposes an eye tracking module for the XR Space Framework aimed at enhancing human performance in XR-based applications, specifically in training, screening, and teleoperation. This framework provides a methodology and components that streamline the development of adaptive real-time virtual immersive systems. It contains multimodal measurements - declarative in the form of in-VR questionnaires and objective, including eye tracking, body movement, and psychophysiological data (e.g., ECG, GSR, PPG). A key focus of this paper is the integration of real-time eye tracking data into XR environments to facilitate a biofeedback loop, providing insight into user attention, cognitive load, and engagement. Given the relatively high measurement frequency of eye tracking - recognized as a noninvasive yet robust psychophysiological measure - this technology is particularly well suited for real-time adjustments in task difficulty and feedback to enhance learning and operational effectiveness. Despite its established role in cognitive and attentional studies, implementing eye tracking metrics within dynamic, real-time XR environments poses unique challenges, particularly given the complex moving visuals presented in head-mounted displays (HMDs). This paper addresses these challenges by focusing on the essential aspects of integrating eye tracking in immersive systems based on real-time engines, ultimately facilitating more efficient, adaptive XR applications.

Figures

Figures reproduced from arXiv: 2507.21000 by the authors.

**Figure 2.** Diagram presenting eye tracking data workflow (source: own elaboration) detecting saccades and fixations, that are identified using velocity-threshold identification, where rapid shifts in gaze direction exceeding a defined speed indicate a saccade, while fixations are determined by prolonged gaze on a specific point. Additionally, changes in pupil diameter are monitored, serving as an indicator of cognitive load an… view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

13 extracted references · 10 canonical work pages

[1]

flow: the psychology of optimal expe- rience (1992)

Beck, L.A.: Csikszentmihalyi, mihaly.(1990). flow: the psychology of optimal expe- rience (1992)

work page 1990
[2]

Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on41, 1052 – 1063 (12 2011)

Chanel, G., Rebetez, C., Bétrancourt, M., Pun, T.: Emotion assessment from phys- iological signals for adaptation of game difficulty. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on41, 1052 – 1063 (12 2011). https://doi.org/10.1109/TSMCA.2011.2116000

work page arXiv 2011
[3]

Procedia Com- puter Science207, 1641–1648 (2022)

Duchowski, A.T., Krejtz, K., Volonte, M., Hughes, C.J., Brescia-Zapata, M., Orero, P.: 3d gaze in virtual reality: Vergence, calibration, event detection. Procedia Com- puter Science207, 1641–1648 (2022). https://doi.org/https://doi.org/10.1016/j. procs.2022.09.221, knowledge-Based and Intelligent Information and Engineering Systems: Proceedings of the 26...

doi:10.1016/j 2022
[4]

Frontiers in Psychiatry11(2020)

Imaoka, Y., Flury, A., de Bruin, E.D.: Assessing saccadic eye movements with head-mounted display virtual reality technology. Frontiers in Psychiatry11(2020). https://doi.org/10.3389/fpsyt.2020.572938

work page arXiv 2020
[5]

In: Digital Interaction and Machine Intelligence

Karpowicz, B., Masłyk, R., Skorupska, K., Jabłoński, D., Kalinowski, K., Kobyliński, P., Pochwatko, G., Kornacka, M., Kopeć, W.: Intergenerational interac- tion with avatars in vr: An exploratory study towards an xr research framework. In: Digital Interaction and Machine Intelligence. pp. 229–238. Springer International Publishing, Cham (2022)

work page 2022
[6]

Psychological Research85(02 2021)

Kisker, J., Gruber, T., Schöne, B.: Behavioral realism and lifelike psychophysiolog- ical responses in virtual reality by the example of a height exposure. Psychological Research85(02 2021). https://doi.org/10.1007/s00426-019-01244-9

work page doi:10.1007/s00426-019-01244-9 2021
[7]

In: Machine Intelligence and Digital Interaction Conference

Kopeć, W., Pochwatko, G., Kornacka, M., Stawski, W., Grzeszczuk, M., Skorupska, K., Karpowicz, B., Masłyk, R., Zinevych, P., Knapiński, S., et al.: Human factors in space exploration: Opportunities for international and interdisciplinary collab- oration. In: Machine Intelligence and Digital Interaction Conference. pp. 339–350. Springer (2023)

work page 2023
[8]

Frontiers in Virtual Reality3, 909984 (2022)

McIntosh, V.: Dialing up the danger: Virtual reality for the simulation of risk. Frontiers in Virtual Reality3, 909984 (2022)

work page 2022

Show all 13 references

[9]

MIT Press, Cambridge (1997)

Picard, R.W.: Affective Computing. MIT Press, Cambridge (1997)

1997
[10]

In: 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

Pochwatko, G., Kopec, W., Jędrzejewski, Z., Jaskulska, A., Skorupska, K.H., Kar- powicz, B., Masłyk, R., Barnes, S., Grzeszczuk, M., Lazarek, J., Swidrak, J.: The invisible – experienced: Developing and verifying a vr application for understand- ing air pollution perception an...

2023
[11]

In: Proceedings of the IEEE International Symposium on Mixed and Augmented Reality ISMAR

Pochwatko,G.,Kopec,W.,Swidrak,J.,Jaskulska,A.,Skorupska,K.H.,Karpowicz, B., Masłyk, R., Grzeszczuk, M., Barnes, S., Borkiewicz, P., et al.: Well-being in isolation: Exploring artistic immersive virtual environments in a simulated lunar habitat to alleviate asthenia symptoms. I...

2023
[12]

In: Proceedings of FDG 2023

Rodrigues, P., Fonseca, M., Lopes, P.: Physiological-based difficulty assessment for virtual reality rehabilitation games. In: Proceedings of FDG 2023. FDG ’23, Association for Computing Machinery (2023). https://doi.org/10.1145/3582437. 3587187

2023 doi
[13]

In: 2023 IEEE International Symposium on Mixed and Augmented Reality Ad- junct (ISMAR-Adjunct) (2023)

Schudy, A., Pochwatko, G., Kopeć, W., Karpowicz, B., Skorupska, K., Grzeszczuk, M., Okruszek, L.: A revised and extended paradigm for social and non-social Towards XR Framework for developing adaptive immersive systems 9 stress elicitation in psychological research - a feasibi...

2023

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.

[1] [1]

flow: the psychology of optimal expe- rience (1992)

Beck, L.A.: Csikszentmihalyi, mihaly.(1990). flow: the psychology of optimal expe- rience (1992)

work page 1990

[2] [2]

Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on41, 1052 – 1063 (12 2011)

Chanel, G., Rebetez, C., Bétrancourt, M., Pun, T.: Emotion assessment from phys- iological signals for adaptation of game difficulty. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on41, 1052 – 1063 (12 2011). https://doi.org/10.1109/TSMCA.2011.2116000

work page arXiv 2011

[3] [3]

Procedia Com- puter Science207, 1641–1648 (2022)

Duchowski, A.T., Krejtz, K., Volonte, M., Hughes, C.J., Brescia-Zapata, M., Orero, P.: 3d gaze in virtual reality: Vergence, calibration, event detection. Procedia Com- puter Science207, 1641–1648 (2022). https://doi.org/https://doi.org/10.1016/j. procs.2022.09.221, knowledge-Based and Intelligent Information and Engineering Systems: Proceedings of the 26...

doi:10.1016/j 2022

[4] [4]

Frontiers in Psychiatry11(2020)

Imaoka, Y., Flury, A., de Bruin, E.D.: Assessing saccadic eye movements with head-mounted display virtual reality technology. Frontiers in Psychiatry11(2020). https://doi.org/10.3389/fpsyt.2020.572938

work page arXiv 2020

[5] [5]

In: Digital Interaction and Machine Intelligence

Karpowicz, B., Masłyk, R., Skorupska, K., Jabłoński, D., Kalinowski, K., Kobyliński, P., Pochwatko, G., Kornacka, M., Kopeć, W.: Intergenerational interac- tion with avatars in vr: An exploratory study towards an xr research framework. In: Digital Interaction and Machine Intelligence. pp. 229–238. Springer International Publishing, Cham (2022)

work page 2022

[6] [6]

Psychological Research85(02 2021)

Kisker, J., Gruber, T., Schöne, B.: Behavioral realism and lifelike psychophysiolog- ical responses in virtual reality by the example of a height exposure. Psychological Research85(02 2021). https://doi.org/10.1007/s00426-019-01244-9

work page doi:10.1007/s00426-019-01244-9 2021

[7] [7]

In: Machine Intelligence and Digital Interaction Conference

Kopeć, W., Pochwatko, G., Kornacka, M., Stawski, W., Grzeszczuk, M., Skorupska, K., Karpowicz, B., Masłyk, R., Zinevych, P., Knapiński, S., et al.: Human factors in space exploration: Opportunities for international and interdisciplinary collab- oration. In: Machine Intelligence and Digital Interaction Conference. pp. 339–350. Springer (2023)

work page 2023

[8] [8]

Frontiers in Virtual Reality3, 909984 (2022)

McIntosh, V.: Dialing up the danger: Virtual reality for the simulation of risk. Frontiers in Virtual Reality3, 909984 (2022)

work page 2022