{"id":"21b015cc-c7cd-4463-8b64-12b67d2af226","arxiv_id":"2502.05100","paper_version":1,"verdict":"REJECT","confidence":"MODERATE","novelty_score":3.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"In a VR supermarket task with 40 participants, hand-based interaction was preferred for immersion (75%) but controller-based interaction was perceived as more precise, reproducing the known naturalness-versus-control trade-off.","lead":"A study of 40 people compared using hands versus controllers in a virtual reality supermarket and found most preferred hands for immersion but controllers for precision. It highlights a design trade-off for anyone building VR shopping or training experiences, though the evidence is mostly subjective.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The central precision/reliability trade-off is asserted, not measured: no objective task-performance data are reported, so the paper's main contrast cannot be evaluated.","rationale":"The reader's weakest assumption was that the simple cereal-selection task does not generalize to realistic shopping. I see an even more fundamental problem: the study never measures precision or reliability objectively. The Methods section defines questionnaires as the collected data, and the Results section reports only qualitative impressions plus questionnaire means. Even a richer, more representative task would not rescue the central precision claim if no performance metric is recorded. The reader's rationale did mention the absence of performance metrics, so there is partial agreement, but the reader's stated weakest assumption focuses on task representativeness rather than the missing outcome variable. The load-bearing concern is therefore that the paper's key comparative claim about controller precision is not empirically testable from the reported data. The paper does have some strengths: a within-subjects design with randomized order, a reasonable sample size of 40, standardized SUS and UEQ-S instruments, and a clear subjective preference result. These support the immersion-preference part of the claim, but they cannot support the precision part. Since the central claim's second half is unsupported, the reader's REJECT verdict remains appropriate; no verdict change is needed.","tokens_in":4249,"tokens_out":2872,"duration_ms":31307,"concrete_test":"Obtain the raw per-participant trial logs from the authors (or rerun the same 40-person within-subjects protocol with objective logging) and compute for each condition: (1) mean number of grasp/trigger attempts per item, (2) mean completion time per task, and (3) number of failed placements (dropped or incorrectly shelved items). Compare conditions with a paired Wilcoxon signed-rank test on each metric. If controllers do not show a significant advantage on at least one objective accuracy/efficiency metric, the paper's claim that controllers offer greater precision and reliability for fine-motor tasks should be revised to a subjective-preference claim; if the logs do show such an advantage, the claim would be supported and the rejection should be revisited.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The study's central claim has two parts. The first, that hand-based interaction was preferred for immersion, is supported by a direct 75% preference response. The second, that controller-based interaction 'offered greater precision and reliability, making it more suitable for tasks requiring fine motor skills,' is not supported by any objective performance measurement. Section 2 lists collected data: demographics, ATI, SUS, UEQ-S, and custom Likert questions. No task-performance variables—grasp attempts, completion time, error count, placement accuracy—are defined as outcomes, and Section 3 reports no such metrics. The precision advantage rests entirely on qualitative statements ('hand-based interaction often resulted in multiple attempts') and on questionnaire means whose inferential status is unclear: the paper says differences 'were not statistically significant' without reporting tests. Because the precision claim is the load-bearing justification for recommending controllers in fine-motor tasks, and because no measured precision variable appears anywhere in the reported experiment, the central trade-off conclusion is empirically ungrounded. If task logs were collected and omitted, they must be reported; if not, the study could not have detected precision differences even with a more representative shopping task.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper reports a within-subjects VR shopping experiment with 40 participants comparing hand-tracking and controller-based interaction for selecting cereal packages from a virtual shelf. It collects demographic data, ATI, SUS, UEQ-S, and custom Likert/preference questions, and reports that 75% of participants preferred hand-based interaction for its immersive feel, while usability scores were similar between conditions. The paper concludes that hand interaction is more natural and immersive but that controllers offer greater precision and reliability, making them more suitable for fine-motor tasks.","tokens_in":4435,"tokens_out":2718,"duration_ms":29108,"significance":"If the precision/reliability trade-off were empirically supported, the finding would offer practical guidance for VR shopping and similar manipulation tasks. The study uses a sound within-subjects design, randomized condition order, identical virtual hand rendering across conditions, and validated questionnaires (SUS, UEQ-S, ATI), which are strengths. However, the paper reports no objective task-performance data and no inferential statistics, so the core claim that controllers 'offered greater precision and reliability' is not evidenced by the reported experiment. The descriptive preference result is clear, but the central trade-off conclusion is ungrounded as presented.","major_comments":[{"comment":"The statement that UEQ and SUS differences 'were not statistically significant' is unsupported: no test statistic, p-value, confidence interval, or standard deviation is reported anywhere in the manuscript. Without inferential statistics, the reader cannot determine whether the near-identical means indicate real similarity or merely underpowered measurement. This is load-bearing because the paper's argument about comparable usability between hands and controllers rests on these numbers.","section":"Section 3 (Results and Discussion)"},{"comment":"The paper claims that controller-based interaction 'offered greater precision and reliability' and that hand-based interaction 'often resulted in multiple attempts to grasp and manipulate objects, causing frustration and inefficiencies,' yet no objective task-performance variables (e.g., grasp attempts, completion time, error count, placement accuracy) are defined in Section 2 or reported in Section 3. The precision claim is supported only by qualitative assertions and questionnaire means, which are not measures of actual task performance. This is a central, load-bearing part of the conclusion and is empirically ungrounded.","section":"Section 2 (Methods) and Section 3 (Results and Discussion)"},{"comment":"The 75% preference result and the 48%/48% ease-of-use split are presented without any statistical test (e.g., a binomial test against a 50% baseline) and without confidence intervals. Additionally, the gender-related observation ('Female participants found hand-based interaction easier to use, while male participants preferred controllers') is based on unspecified subgroup counts and no interaction test. Given the small total sample (40) and missing responses (39 and 38 for the custom questions), these claims should at least be accompanied by exact subgroup sizes and inferential tests or be explicitly labeled as exploratory.","section":"Section 3 (Results and Discussion)"},{"comment":"The task design—two trials of selecting three cereal packages from a single shelf—does not appear to require the 'fine motor skills' invoked in the abstract and conclusion. The paper generalizes from this minimal task to a broad precision/immersion trade-off in VR shopping, but the chosen task lacks the navigation, product variety, time pressure, and fine-grained manipulation demands of realistic shopping. The authors themselves call for 'more complex tasks' in future work, which is appropriate, but this limits the external validity of the current central claim.","section":"Section 2 (Methods) and Section 4 (Conclusion)"}],"minor_comments":[{"comment":"The experimental instructions for the two tasks ('healthy' versus 'tasty' cereal selection) are not specified beyond these category labels; future replication would benefit from a description of how 'healthy' and 'tasty' were operationalized (e.g., package labels, participant judgment) and whether participants received any training or practice trials.","section":"Section 2 (Methods)"},{"comment":"The figure caption and axes are incomplete: it does not state what the proportions represent, how missing responses are handled, or the number of participants per gender group. The reader cannot assess the stability of the 75% preference or the gender split without this information.","section":"Figure 1"},{"comment":"Reference [17] appears to duplicate reference [5] (same title, same journal and page), and reference [8] shares the same journal/issue/page as [17] but with a different title; reference [7] has a DOI that may not correspond to a real article. The reference list needs to be checked and corrected for these apparent errors.","section":"References"},{"comment":"'Ease of use was evenly split, with 48% of participants favoring each method' is confusing because only 38 respondents answered this question; 48% of 38 is approximately 18, so a 48/48 split leaves 4% unaccounted for. Please clarify whether there was a 'no preference' option or how missing data were treated.","section":"Section 3 (Results and Discussion)"}],"recommendation":"reject","confidential_remarks":"The manuscript reads more like a descriptive workshop contribution than a full journal paper. The central precision claim is not measured, and the reported statistics are insufficient. The apparent duplicate and potentially incorrect references are a separate concern that should be flagged to the authors if a resubmission is considered."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The central problem with this paper is that its headline trade-off is asserted, not measured. The abstract and conclusion claim controllers offer greater precision and reliability, but no objective performance data appear anywhere in the methods or results. The stress-test note is correct: Section 2 lists questionnaires and no task-performance variables, and Section 3 reports no grasp attempts, completion times, or error counts. The precision half of the conclusion rests on a qualitative 'often resulted in multiple attempts' and on questionnaire means whose inferential status is unclear.\n\nWhat the paper does have: a clean within-subjects design with 40 participants, randomization, ethics approval, and standardized instruments (ATI, SUS, UEQ-S). The 75% preference for hand tracking is a concrete, descriptive data point for a VR supermarket context, which is new even though the underlying immersion-vs-precision trade-off is already documented in the paper's own citations. The authors also explicitly call for more complex tasks, so they do not overclaim generality.\n\nThe soft spots are proportionate. The missing performance metrics are load-bearing: the recommendation to use controllers for fine-motor shopping tasks is unjustified without objective accuracy data. The paper says differences were 'not statistically significant' but reports no tests, no standard deviations (except demographics), and no confidence intervals. That is an empirical paper that cannot be evaluated as presented. The reference list is also a red flag: [5] and [17] are the same article under different author lists, and [7] and [8] have suspicious DOIs and author names. Whether from a citation-manager error or not, this needs correction before the paper can be trusted.\n\nWho is this for? People building VR retail interfaces might use the 75% preference figure as a hint, but they should not rely on the precision claim without further evidence. As a scientific contribution, it does not currently meet the bar for a reliable empirical study. Given the sound design and active application area, I would not desk-reject it. A serious referee should ask for the performance data, proper statistical reporting, and verification of every reference. If the authors supply those, the paper could become a modest but useful data point. In its current form, I would not cite it.\n\nRecommendation: send to peer review with a request for major revision and a careful reference check.","headline":"The precision claim is asserted, not measured; a clean but statistically incomplete VR shopping study with reference-list red flags.","tokens_in":4952,"tokens_out":4010,"would_cite":false,"duration_ms":36088,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper claims that in a virtual supermarket, hand-tracking and controllers score similarly on usability, yet 75% of 40 participants prefer hand-based interaction for its natural, immersive feel, while controllers win on precision and…","keywords":["Virtual Reality","Hand Tracking","Controller-Based Interaction","VR Shopping","User Experience","Usability","Interaction Methods","Supermarket Simulation"],"falsifier":"Run a within-subjects VR shopping study with a larger product set, aisles to navigate, and a time limit, and measure task completion time, error rate, and grasping attempts; if controllers show a clear performance advantage while hand tracking remains preferred, the trade-off stands, but if precision differences disappear or reverse under realistic load, the paper's central contrast would be falsified.","tokens_in":4079,"feed_emoji":"🛒","tokens_out":2551,"duration_ms":28342,"temperature":0.7,"pith_summary":"The paper tries to establish how interaction method shapes user experience in a VR shopping task, comparing bare-hand tracking against controller-based input. It finds that both methods are rated as similarly usable, but preferences split: hand tracking is favored for immersion and natural gestures, while controllers are seen as more precise for picking up items. The study argues that VR shopping interfaces should therefore offer both modes, letting users switch depending on whether the task values immersion or fine motor control. A sympathetic reader would care because this trade-off between naturalness and precision recurs across VR applications beyond shopping, and the study offers one of the few direct within-subject comparisons in a consumer-oriented high-fidelity setting.","feed_headline":"VR shoppers prefer bare hands, but controllers are more precise","feed_subtitle":"In a supermarket simulation, 75% chose hand tracking for immersion while controllers won on accuracy.","key_machinery":"The central machinery is a within-subjects experimental design in which each participant performs two cereal-selection tasks in both interaction conditions, with virtual hands rendered identically for hand tracking and controller input to isolate the input modality. The study measures outcomes through the System Usability Scale, the User Experience Questionnaire Short, the Affinity for Technology Interaction scale, and custom Likert items on preference and ease of use, then compares these scores and preference distributions to map the trade-off between immersion and precision.","core_discovery":"In a within-subjects experiment of 40 participants selecting cereal packages in a simulated supermarket, the paper reports that System Usability Scale scores were comparable (hand-based M = 71.38, controller M = 68.88) and pragmatic quality ratings were nearly identical, while hedonic quality slightly favored hand tracking (M = 2.00 vs. 1.94). Despite this statistical parity, 75% of participants preferred hand-based interaction because it felt natural and immersive, even though it required repeated grasping attempts and lacked haptic feedback; controllers provided smoother, more accurate manipulation. The paper concludes that neither method dominates, and that VR shopping platforms should support customizable interaction modes rather than assume one input method fits all tasks.","pith_inferences":["The following inferences extend beyond the paper's explicit claims and are the editor's own. First","the paper's minimal task (selecting three cereal packages) likely suppresses the precision advantage of controllers","with more items","navigation","or time pressure","the performance gap would probably widen","so the reported parity may be upper-bound for hand tracking. Second","since controllers in this study also had no haptic feedback"],"forward_implications":["VR shopping applications should offer both hand-tracking and controller modes, defaulting to hands for exploratory browsing but allowing controllers for tasks like checking product details or precise placement.","Because hand tracking's main weakness is lack of haptic feedback, adding even simple vibrotactile or proxy-based haptics could close the usability gap without sacrificing immersion.","The even split in perceived ease of use (48% each) suggests that usability judgments depend on prior device familiarity, so training or onboarding may matter more than the input method itself.","The gender difference observed (female participants found hands easier, male participants preferred controllers) implies that user populations with different gaming or controller experience will respond differently to VR shopping interfaces.","If both input methods perform comparably on standardized usability measures, then preference, not performance, becomes the deciding factor, pushing designers to focus on user choice and adjustable settings."],"supporting_citations":[{"why":"Establishes the known opportunities and challenges of hand tracking in immersive VR, framing the expected usability and precision limitations.","marker":"[1]"},{"why":"Supplies the Affinity for Technology Interaction scale used to characterize the participant sample.","marker":"[3]"},{"why":"Provides evidence on how input modality affects motor tasks in VR, directly motivating the comparison of virtual hands versus controllers.","marker":"[4]"},{"why":"Reports a prior comparative study of interaction time and usability between controllers and hand tracking in VR training, a key baseline for the current findings.","marker":"[5]"},{"why":"Documents a controlled evaluation showing controllers outperform bare hands on interaction performance, supporting the precision advantage claimed here.","marker":"[11]"},{"why":"Offers recent findings on mixed interaction methods for object manipulation in VR, underpinning the recommendation for customizable modes.","marker":"[14]"},{"why":"Demonstrates that passive haptics enhance virtual environments, which the paper cites to explain the hand-tracking haptic feedback deficit.","marker":"[15]"},{"why":"Challenges the assumption that hand tracking always improves perceived naturalness, which the paper uses to temper the immersion narrative.","marker":"[16]"},{"why":"Provides the User Experience Questionnaire Short instrument used to measure pragmatic and hedonic quality.","marker":"[18]"}],"fun_headline_variants":["75% of VR shoppers pick hands, not controllers","VR shoppers favor hands for immersion, controllers for accuracy","Hands more immersive, controllers more precise in VR shopping","No clear winner: hands feel better, controllers work better","VR study: 75% prefer hands despite controller precision"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that selecting three cereal packages from one shelf in a laboratory is a representative virtual shopping task, so the observed balance between immersion and precision generalizes to real shopping with many products, navigation, and time pressure.","fun_headline_variants_meta":{"raw":{"variants":["75% of VR shoppers pick hands, not controllers","VR shoppers favor hands for immersion, controllers for accuracy","Hands more immersive, controllers more precise in VR shopping","No clear winner: hands feel better, controllers work better","VR study: 75% prefer hands despite controller precision"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00098,"raw_usage":{"total_tokens":4071,"prompt_tokens":769,"completion_tokens":3302,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":385,"completion_tokens_details":{"reasoning_tokens":3223}},"tokens_in":385,"tokens_out":3302,"duration_ms":23092,"temperature":1.0,"reasoning_tokens":3223,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-08T20:14:40.521050+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run a within-subjects VR shopping study with a larger product set, aisles to navigate, and a time limit, and measure task completion time, error rate, and grasping attempts; if controllers show a clear performance advantage while hand tracking remains preferred, the trade-off stands, but if precision differences disappear or reverse under realistic load, the paper's central contrast would be falsified.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Establishes the known opportunities and challenges of hand tracking in immersive VR, framing the expected usability and precision limitations."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the Affinity for Technology Interaction scale used to characterize the participant sample."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides evidence on how input modality affects motor tasks in VR, directly motivating the comparison of virtual hands versus controllers."},{"cited_title":"F., M ¨obus, M., Fender, A., & Holz, C","cited_arxiv_id":null,"evidence_quote":"Documents a controlled evaluation showing controllers outperform bare hands on interaction performance, supporting the precision advantage claimed here."},{"cited_title":"M., & Marks, S","cited_arxiv_id":null,"evidence_quote":"Offers recent findings on mixed interaction methods for object manipulation in VR, underpinning the recommendation for customizable modes."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Demonstrates that passive haptics enhance virtual environments, which the paper cites to explain the hand-tracking haptic feedback deficit."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Challenges the assumption that hand tracking always improves perceived naturalness, which the paper uses to temper the immersion narrative."}],"review_version":1}