{"id":"a7ce30eb-189c-47a3-a764-2fe7280c6d6a","arxiv_id":"2508.18580","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":2,"one_line_summary":"Two VR neck rehabilitation games, a chin tuck survival game and a spaceship-guided range of motion game, scored above usability thresholds and earned positive engagement ratings in a preliminary study of 19 adults.","lead":"Researchers built and tested two virtual reality games that turn neck rehabilitation movements into play, one based on fighting monsters with chin tucks and one based on guiding a spaceship by moving the head. In a trial with 19 young adults, both games received high usability and engagement ratings.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The tracking-validation gap is load-bearing: without a reference check, headset translation/rotation may reward compensatory movements, so the usability scores do not yet establish exercise fidelity; conditional verdict stands.","rationale":"The reader's conditional verdict identifies the same weakest assumption: the system's mapping from headset tracking signals to exercise events is not validated. My stress-test pass agrees and finds this to be the most load-bearing concern for the central claim. The paper's own Section 6 states that accuracy validation was not performed, which is an explicit flag in the manuscript. This is not merely a gap in clinical efficacy evidence; it is a threat to the internal validity of the games as exercise-delivery tools. If the chin tuck detector can be triggered by torso or upper-body movement, then high usability scores and even positive perceived health value could coexist with games that do not train the intended deep neck flexor muscles. For a rehabilitation application, that distinction matters: 'excellent usability' is not evidence of 'suitable for the intended exercise' without tracking validation. I did not elevate the lack of a control condition or the healthy-young-adult sample to the primary concern, because the paper makes an exploratory usability claim, not a comparative effectiveness claim, and the Discussion already limits generalization. The verification step I propose is inexpensive and would directly settle whether the sensor-to-exercise mapping is sound. Since the reader already made the verdict conditional on this issue, my analysis does not move the verdict.","tokens_in":11984,"tokens_out":4780,"duration_ms":52982,"concrete_test":"Conduct a motion-capture validation substudy with N=10-15 healthy adults. Using an optical motion capture system with markers on the head, sternum, and chair, have participants play the chin tuck game while performing scripted true chin tucks, neck extension, forward head translation, and torso leans. A physiotherapist blinded to game state labels each monster wave as a correct chin tuck or a compensatory movement. Compare the game's recorded 'perfect chin tucks' against these labels and compute sensitivity and positive predictive value at the configured Z-threshold. If PPV is below 0.8 or if torso-lean/extension false positives exceed 5%, the detector rewards non-chin-tuck movements and the central suitability claim is unsupported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim of the paper is that the proposed VR neck rehabilitation games demonstrate excellent usability, engagement, and perceived health value. A load-bearing condition for that claim is that the games actually detect the intended cervical movements. That condition is not secured. In Section 3.2.2, a chin tuck is registered when headset backward Z-axis displacement exceeds a threshold while lateral and rotational movement stays low. But a chin tuck is a small retraction of the chin relative to the neck, not primarily a translation of the head; the same backward-Z signal can be produced by torso lean, sliding in the chair, or neck extension, and the game would reward these as successful chin tucks. In Section 3.3.2, lateral flexion is registered from headset rotation about the Z-axis above a threshold, and the ROM maxima are computed from calibrated headset positions. Headset roll is not uniquely cervical lateral flexion, and position-based angle estimates conflate translation with rotation. The authors explicitly acknowledge in Section 6 that they did not perform additional accuracy validation for their application, relying on prior reliability studies of head-mounted display tracking. Those studies validate gross head tracking, not the exercise-specific event classifiers used here. If the detectors have substantial false positives, the high SUS and UX scores do not establish that the games deliver the intended exercise, undermining the claim that the games are suitable for their rehabilitation purpose.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents two novel VR rehabilitation games for cervical exercises: an Indiana Jones-themed chin tuck game using a survival/level-progression mechanic and a space-themed neck range-of-motion game using an ambient constellation-revealing reward. The authors report a preliminary user study with 19 healthy young adults (some with mild self-limited neck pain) that evaluates usability, engagement, and perceived health value via the System Usability Scale (SUS), an 11-item custom UX questionnaire, free-form comments, and gameplay logs. Both games received high SUS scores (83.0 and 90.4, both significantly above 68), most UX ratings were significantly above neutral, and participants expressed willingness to use the games long-term. The paper also discusses limitations, notably the lack of dedicated tracking accuracy validation.","tokens_in":12212,"tokens_out":3946,"duration_ms":39108,"significance":"If the reported results hold, the paper offers two concrete gamification designs, including a survival/level-progression mechanic for chin tuck exercises and an ambient reward mechanism for ROM exercises, which are underexplored in VR neck rehabilitation. Strengths include close collaboration with certified athletic therapists in protocol design, a configurable system with session logging that could support future clinical use, and transparent reporting of statistical tests. However, the significance is limited by the lack of exercise-specific movement detection validation, the preliminary healthy-young-adult cohort, and the absence of a control condition. The paper's main contribution is as an exploratory design study, not as evidence of clinical efficacy.","major_comments":[{"comment":"The central claim that the games are 'suitable for the intended exercises' is not secured because the headset-based movement detection has not been validated against a reference standard. In Section 3.2.2, a chin tuck is registered from backward head translation along the Z-axis, but a chin tuck is primarily a retraction of the chin relative to the neck, not a whole-head translation; torso lean, chair slide, or neck extension can produce the same Z displacement and be rewarded as a valid chin tuck. In Section 3.3.2, lateral flexion is detected from headset rotation about the Z-axis, which conflates head roll with cervical lateral flexion, and the ROM angles are computed from headset world-space positions, which are sensitive to head translation as well as orientation. The authors acknowledge in Section 6 that they did not perform additional accuracy validation, citing prior reliability studies of HMD tracking; however, those studies validate gross head tracking, not the exercise-specific event classifiers used here. This gap directly affects the interpretation of the high SUS and UX scores as evidence that the games deliver the intended therapeutic movements. I recommend either adding a validation study (e.g., against optical motion capture or therapist observation) or clearly re-scoping the claims to 'perceived usability and engagement' without asserting exercise fidelity.","section":"Section 3.2.2, 3.3.2, and Section 6"},{"comment":"The statistical analysis does not correct for multiple comparisons. The paper reports Wilcoxon signed-rank tests for each of the 11 UX items for each game (22 tests total) and claims that 'for all the UX questions for both games, their scores are significantly better than the neutral score of 3 (p < 0.02) except for the chin tuck game, the question related to the challenging level of the physical exercise received a score of 3.6±1.3 (p=0.062)'. With 22 comparisons, the family-wise error rate is inflated; a Bonferroni correction would set alpha at approximately 0.0023, and many of the reported p-values in the 0.01–0.02 range would no longer be significant, and the borderline chin-tuck challenge item would not be an isolated exception. This weakens the claim of uniformly positive UX. I recommend reporting corrected p-values, using a global test (e.g., a mixed-effects model or Friedman's test per game), or clearly labeling these results as exploratory without invoking strict significance thresholds.","section":"Section 4 and Section 5.1"},{"comment":"There is an internal inconsistency in how head movements are measured for the ROM game. The interaction is described as using head orientation rather than position ('The system uses head orientation rather than position information from the VR headset to interact with the virtual environment'), but the maximum angles for flexion, extension, lateral flexion, and rotation are computed from calibrated headset positions ('the system logs the headset’s world-space position for that orientation'). If the position values are the primary source of the angle calculations, a user can artificially inflate measured ROM by translating the head or torso toward a target rather than rotating the neck, which further compromises the validity of the reported angular metrics. Please clarify the exact computation and justify why position-based angles are appropriate for measuring cervical ROM.","section":"Section 3.3.2"}],"minor_comments":[{"comment":"There is a typo: 'the duration of a chink tuck becomes longer' should be 'chin tuck'.","section":"Figure 1 caption"},{"comment":"The text says 'Loosing the game will result in a sad music with a damaged artifact' – 'Loosing' should be 'Losing', and 'a sad music' should be 'sad music'.","section":"Section 3.2.4"},{"comment":"The sentence 'attitude towards the design elements of the games' is written as 'altitude towards the design elements'; please correct this typo.","section":"Section 4"},{"comment":"The sentence beginning 'F or these questions' has a stray space – should be 'For these questions'.","section":"Section 4"},{"comment":"The claim that '16 out of 19 participants were able to win the game by performing 10 sets of 10-second chin tucks' is ambiguous; based on the protocol in Section 3.2.1, it should be '10 chin tucks' rather than '10 sets'.","section":"Section 5.1 and Table 1"},{"comment":"The phrase 'for the first time' regarding the survival/level-progression strategy for chin tuck exercises is a strong claim that may be difficult to substantiate given the rapid growth of VR rehabilitation literature; consider softening to 'to our knowledge'.","section":"Section 2 and 6"}],"recommendation":"major_revision","confidential_remarks":"The paper is well-written and the topic is timely, but the main gap—unvalidated movement detection—is load-bearing for the claim that the games are suitable for the intended exercises. The authors do acknowledge this limitation, which is good, but the manuscript as it stands overstates the significance of the results. A revision that either adds validation data or clearly narrows the claims to usability/engagement (and adds multiple-comparison correction) would make the paper publishable as an exploratory study. I would also ask the authors to moderate the 'first time' claim in Section 2, as it may invite unnecessary scrutiny."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: this paper is a useful design-oriented contribution, and its headline claim about usability and engagement holds for the healthy young adults they tested. The tracking-validation gap flagged in the stress test is real, but I would not call it fatal for what this paper actually is. It becomes load-bearing only if you read \"suitable for the intended exercises\" as a claim about exercise fidelity rather than perceived suitability. The authors mostly stay on the right side of that line, though they blur it in the abstract and conclusion.\n\nWhat is genuinely new: the Indiana Jones-style chin tuck game is, as far as I can tell from the cited literature, the first gamified survival/level-progression template for chin tuck strengthening, and the constellation-based ambient reward for ROM is a reasonable alternative to the token-collection and shooting themes that dominate the prior work. The system description is unusually concrete: calibration procedure, configurable thresholds, JSON configuration, play logs, and real-time feedback are all specified well enough to reproduce the prototypes. The evaluation is appropriate for an exploratory study: SUS scores are high and statistically above threshold, the supplementary UX questions mostly point the right way, and the free-text responses are reported fairly, including negative comments. The authors also deserve credit for explicitly listing their limitations, including the fact that they did not validate tracking accuracy for their specific exercise classifiers.\n\nThe soft spots, in rough order of importance. First, the movement-detection story is under-supported. A chin tuck is a retraction of the chin relative to the neck, not primarily a whole-head translation, so detecting it as backward Z-axis displacement of the headset can reward torso lean, chair sliding, or cervical extension. Similarly, measuring lateral flexion as headset Z-axis rotation conflates roll with translation. The cited reliability studies validate gross head tracking, not these event classifiers. The authors acknowledge this in Section 6, but they still claim the games are \"suitable for the intended exercises\" in the hypothesis and conclusion. That overstates what the data support. Second, the custom UX questionnaire is not validated and they run multiple Wilcoxon comparisons without any correction; the p-values should be read as descriptive. This is a minor issue for an exploratory study. Third, there is no baseline or comparison condition, and the sample is limited to healthy young adults. The authors acknowledge both, so this is a scope constraint rather than a fatal flaw.\n\nBottom line: this deserves a serious referee. The right outcome is probably minor-to-moderate revision: either add a small tracking-accuracy check (even a simple motion-capture or IMU comparison on a few subjects would help) or soften the exercise-fidelity claims and frame the contribution strictly as perceived usability and engagement of the gamification strategies. I would cite this paper if I were working in VR rehabilitation design, and I would bring it to a reading group as an example of honest exploratory work in a niche that needs more tested prototypes.\n\nRecommendation: send it to peer review.","headline":"A solid exploratory usability study of two genuinely novel VR gamification strategies for neck exercises, with an honest limitations section but a real movement-detection validity gap that should be fixed or clearly scoped before the 'suitable for the intended exercises' claim is taken at face value.","tokens_in":12724,"tokens_out":1903,"would_cite":true,"duration_ms":21893,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper claims two gamified VR neck exercises—a survival-based chin tuck game and a space-themed range-of-motion game—are usable, engaging, and perceived as health-valuable for healthy young users.","keywords":["virtual reality","neck rehabilitation","chin tuck","range of motion","gamification","system usability scale","chronic neck pain","head-mounted display"],"falsifier":"Equip 10–15 participants with a marker-based motion-capture reference or have a therapist watch 20 chin-tuck attempts while playing the game. If the game registers a shield-triggering chin tuck for head translations or tilts that are not true chin tucks, or misses true chin tucks, then the detection logic is not reliable enough to deliver the prescribed exercise.","tokens_in":11806,"feed_emoji":"🎮","tokens_out":6357,"duration_ms":56313,"temperature":0.7,"pith_summary":"Chronic neck pain rehabilitation suffers from poor adherence and high cost, and VR-based neck exercise has been underexplored—especially strengthening exercises like the chin tuck. This paper builds and tests two VR games: an Indiana Jones-themed chin tuck game using a survival and level-progression reward system, and a space-themed neck range-of-motion game using ambient constellation rewards. In a study with 19 healthy young adults (some with mild self-limited neck pain), both games scored well above the standard usability threshold (SUS 83.0 for chin tuck, 90.4 for ROM), and most user-experience ratings were significantly above neutral. The authors conclude that the two gamification strategies are usable, engaging, and perceived as health-valuable, and position the system for further development toward clinical use.","feed_headline":"VR neck rehab games clear usability bar in first trial","feed_subtitle":"Chin-tuck survival game and space-themed ROM game earned SUS 83 and 90 from 19 healthy users.","key_machinery":"The load-bearing mechanism is headset-only kinematic tracking with per-user calibration. For the chin tuck game, the headset's calibrated neutral position is used as the origin; a valid chin tuck is registered when backward displacement along the headset's Z-axis exceeds a configurable threshold while lateral and rotational movement stays minimal, activating the shield. For the ROM game, six calibration points define the user's maximum reach; gameplay uses head-orientation raycasting with fixation timing to guide a spaceship along those points, and lateral flexion is detected by headset Z-axis rotation exceeding a threshold with a reset-to-neutral check. All interaction, feedback, scoring, and level progression is driven by these head-position and rotation signals plus configurable parameters stored in JSON files.","core_discovery":"The central claim is that the two proposed VR games successfully gamify two different kinds of cervical rehabilitation exercises—the chin tuck, a deep-neck-muscle strengthening movement, and neck range-of-motion exercise. The chin tuck game uses a survival and level-progression reward (defending a sacred artifact from monster attacks), and the ROM game uses an ambient reward (unlocking constellations), rather than the token/coin collection seen in earlier rehabilitation games. In the user study, the chin tuck game scored 83.0 and the ROM game 90.4 on the System Usability Scale, both significantly above the 68 threshold; all but one user-experience item were significantly above neutral; and 16 of 19 participants completed the chin tuck game's final 10-second-hold level. The authors take these results as evidence that the two gamification strategies work well for usability, engagement, and perceived health value, and as a foundation for future longitudinal testing with chronic neck pain patients.","pith_inferences":["If the headset tracking is validated against a reference standard, the same calibration-and-threshold approach could extend to other precision movements, such as cervical retraction with resistance or balance-while-tracking tasks, without changing the core game engine.","The participants' comments about shield-activation timing versus monster-attack duration hint that the detection threshold and the wave timing interact; tightening the feedback loop may matter more than adding game content.","The study's sample is young and mostly VR-familiar; the strongest next test is mid-age chronic neck pain patients, who carry the adherence burden this design aims to fix and who may tolerate the games' pacing differently."],"forward_implications":["If the results replicate, the survival-and-level-progression strategy offers a template for gamifying muscle-strengthening neck exercises, which have been largely neglected relative to ROM exercises.","The ambient constellation reward provides an alternative to token-collection mechanics that may be better suited to slow, controlled movement tasks and to patients who find fast-paced reward chasing stressful.","The configurable parameters, personalized calibration, and session logs make the system adaptable to therapist-supervised dosing and to future adaptive-difficulty algorithms.","The high SUS scores and participants' stated willingness to use the games 2–3 times per week for six weeks or longer suggest the approach could address adherence and accessibility barriers in home-based neck rehabilitation."],"supporting_citations":[{"why":"Defines the System Usability Scale, the primary metric for both usability claims.","marker":"[2]"},{"why":"Randomized controlled trial of VR neck rehabilitation games that this work extends with new gamification themes.","marker":"[8]"},{"why":"Systematic review establishing the state of VR neck-pain rehabilitation and the gap this study targets.","marker":"[9]"},{"why":"Provides the epidemiology of neck pain that motivates the need for accessible rehabilitation.","marker":"[11]"},{"why":"Prior clinical use of commercial VR for neck and low-back pain, used as a feasibility baseline and contrast for game themes.","marker":"[14]"},{"why":"Prior validation of Meta Quest headset tracking for neck movement, cited in place of new tracking validation.","marker":"[18]"}],"fun_headline_variants":["Chin-tuck survival game scores SUS 83, ROM game 90","VR neck rehab games earn SUS 83 and 90 in pilot","Survival and ambient reward strategies pass usability bar in VR neck rehab","Gamified neck exercises: chin tuck survival and ROM ambient reward score high","High SUS scores for gamified VR neck rehab games in exploratory study"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The entire system rests on the assumption that a consumer VR headset's positional and rotational readings correctly identify a chin tuck and a lateral flexion; the authors explicitly did not validate tracking accuracy for these exercises in this study.","fun_headline_variants_meta":{"raw":{"variants":["Chin-tuck survival game scores SUS 83, ROM game 90","VR neck rehab games earn SUS 83 and 90 in pilot","Survival and ambient reward strategies pass usability bar in VR neck rehab","Gamified neck exercises: chin tuck survival and ROM ambient reward score high","High SUS scores for gamified VR neck rehab games in exploratory study"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000631,"raw_usage":{"total_tokens":2917,"prompt_tokens":953,"completion_tokens":1964,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":569,"completion_tokens_details":{"reasoning_tokens":1868}},"tokens_in":569,"tokens_out":1964,"duration_ms":12346,"temperature":1.0,"reasoning_tokens":1868,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-15T16:55:47.830011+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Equip 10–15 participants with a marker-based motion-capture reference or have a therapist watch 20 chin-tuck attempts while playing the game. If the game registers a shield-triggering chin tuck for head translations or tilts that are not true chin tucks, or misses true chin tucks, then the detection logic is not reliable enough to deliver the prescribed exercise.","supporting_citations":[{"cited_title":"Brooke et al","cited_arxiv_id":null,"evidence_quote":"Defines the System Usability Scale, the primary metric for both usability claims."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Randomized controlled trial of VR neck rehabilitation games that this work extends with new gamification themes."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Systematic review establishing the state of VR neck-pain rehabilitation and the gap this study targets."},{"cited_title":"Kazeminasab, S","cited_arxiv_id":null,"evidence_quote":"Provides the epidemiology of neck pain that motivates the need for accessible rehabilitation."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Prior clinical use of commercial VR for neck and low-back pain, used as a feasibility baseline and contrast for game themes."},{"cited_title":"Trinidad-Fern ´andez, B","cited_arxiv_id":null,"evidence_quote":"Prior validation of Meta Quest headset tracking for neck movement, cited in place of new tracking validation."}],"review_version":2}