Visualizing Engineering Fundamentals: Design of Mixed Reality and Physical Toolkits for Effective Learning

Eshwara Prasad Sridhar; Mahmudur Rahman; Md Rassel Raihan; Mohammad Abu Nasir Rakib; Sharmin Akter; Somik Biswas

REVIEW 2 major objections 1 minor 2 references

Students value multimodal experiences combining mixed-reality visualization with hands-on physical interaction in engineering mechanics.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

2026-07-02 06:11 UTC pith:LJOFCKBV

load-bearing objection Small qualitative study comparing MR apps and physical toolkits for engineering mechanics finds students like multimodal interaction but methods details are thin. the 2 major comments →

arxiv 2607.00979 v1 pith:LJOFCKBV submitted 2026-07-01 cs.HC

Visualizing Engineering Fundamentals: Design of Mixed Reality and Physical Toolkits for Effective Learning

Mohammad Abu Nasir Rakib , Sharmin Akter , Eshwara Prasad Sridhar , Somik Biswas , Md Rassel Raihan , Mahmudur Rahman This is my paper

classification cs.HC

keywords mixed realityphysical toolkitsengineering educationuser studythematic analysishuman-centered designmechanics learning

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper presents findings from a user study involving 24 participants who experienced engineering mechanics instruction under three conditions: classroom teaching alone, with a mixed-reality application, and with physical toolkits. Analysis of their feedback showed differences in workflows and engagement depending on the modality used. The results emphasize the importance of designing tools that integrate visual and tactile elements while addressing issues with overly complex displays to better support learning.

Core claim

Thematic analysis revealed that learners valued multimodal and interactive experiences that combined visualization with hands-on interaction, while reporting challenges with complex or unclear visualizations. These insights support the human-centered design of mixed-reality and physical tools for engineering education.

What carries the argument

Comparison of three instructional conditions through thematic analysis of participant feedback to identify variations in learning workflows and engagement.

Load-bearing premise

The self-reported feedback from students in the three conditions reflects real differences in how the tools affect learning rather than just personal preferences or setup variations.

What would settle it

A follow-up experiment that measures actual problem-solving performance before and after each condition and finds equivalent gains across all three would undermine the claimed benefits of the added toolkits.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

Workflows and engagement vary across classroom, mixed-reality, and physical toolkit conditions.
Multimodal experiences that combine visualization and hands-on interaction are valued by learners.
Complex or unclear visualizations can hinder effective use of the tools.
Design of educational tools should be guided by user feedback to prioritize interactive and clear elements.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

These design principles might apply to other STEM subjects involving spatial reasoning.
Future work could test whether these tools lead to improved test scores or retention of concepts.
Implementation in real classrooms may need to account for varying technical infrastructure.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

Small qualitative study comparing MR apps and physical toolkits for engineering mechanics finds students like multimodal interaction but methods details are thin.

read the letter

The paper runs a user study with 24 participants comparing classroom instruction alone against the same plus either a mixed-reality app or a physical toolkit in Engineering Mechanics. Thematic analysis of feedback shows students appreciated combining visuals with hands-on work and ran into trouble with unclear or complex visuals. That is the core result.

The direct side-by-side look at these two tool types in this specific mechanics context is the main new piece. Prior HCI work has done similar comparisons in other domains, so this is an incremental application rather than a new framework, but the engineering-mechanics focus gives it a narrow practical angle.

The study itself is a standard three-condition setup with post-session feedback and thematic coding. That approach can surface useful design notes when done carefully.

The soft spot is the lack of reported safeguards on the analysis. No mention of randomization or assignment method, no inter-rater reliability, no member checking, and no quantitative learning measures. The stress-test point about themes possibly reflecting individual differences or session delivery rather than the modalities themselves is fair based on what is shown. Those gaps make the central claim rest on thinner ground than it needs to.

This is for researchers already working on educational HCI or engineering ed-tech who want concrete examples from mechanics. A reader in that niche could pull a few design pointers from the themes. It is coherent enough on its own terms to deserve a serious referee who can check the full methods and data handling.

Referee Report

2 major / 1 minor

Summary. The paper reports results from a user study with 24 participants comparing three instructional conditions in Engineering Mechanics: classroom instruction alone, classroom instruction augmented by a mixed-reality application, and classroom instruction augmented by physical toolkits. Thematic analysis of participant feedback is used to identify variations in learners' workflows and engagement across modalities. The authors conclude that participants valued multimodal and interactive experiences combining visualization with hands-on interaction, encountered challenges with complex or unclear visualizations, and that the findings support human-centered design of mixed-reality and physical tools for engineering education.

Significance. If the qualitative findings hold after improved methodological reporting, the work provides practical design insights for educational technology in engineering mechanics, highlighting the value of combining visualization and physical interaction. Such contributions can guide development of more effective learning tools in HCI and education research, particularly where self-reported workflow differences are used to inform modality choices.

major comments (2)

[Abstract / User study section] Abstract and methods description of the user study: No details are provided on participant assignment to the three conditions (randomization, between- or within-subjects design, counterbalancing), blinding, or controls for facilitator/order effects. This directly affects the central claim that observed differences in workflows and engagement are attributable to the instructional modalities rather than individual variation or implementation differences.
[Thematic analysis / Results] Thematic analysis description: The manuscript does not report the theme derivation process, number of coders, inter-rater reliability, member checking, or how themes were validated against the data. Without these standard elements, the trustworthiness of the themes and the attribution of engagement differences to modalities cannot be fully assessed.

minor comments (1)

[Abstract] The abstract would benefit from briefly stating the study design type (e.g., between-subjects) and basic participant demographics to allow readers to evaluate generalizability.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for their constructive comments, which highlight important gaps in methodological transparency. We address each point below and will revise the manuscript to provide the requested details.

read point-by-point responses

Referee: [Abstract / User study section] Abstract and methods description of the user study: No details are provided on participant assignment to the three conditions (randomization, between- or within-subjects design, counterbalancing), blinding, or controls for facilitator/order effects. This directly affects the central claim that observed differences in workflows and engagement are attributable to the instructional modalities rather than individual variation or implementation differences.

Authors: We agree that these details are missing from the current manuscript and that their absence limits assessment of the claims. The revised version will expand the User Study section with a full description of participant assignment procedures, the overall design structure, any randomization or counterbalancing used, blinding (if applicable), and steps taken to control for facilitator and order effects. revision: yes
Referee: [Thematic analysis / Results] Thematic analysis description: The manuscript does not report the theme derivation process, number of coders, inter-rater reliability, member checking, or how themes were validated against the data. Without these standard elements, the trustworthiness of the themes and the attribution of engagement differences to modalities cannot be fully assessed.

Authors: The referee is correct that the manuscript omits standard reporting on the qualitative analysis. In the revision we will add a dedicated subsection describing the thematic analysis process, including the number of coders, how themes were derived and iterated upon, any inter-rater reliability measures, member checking, and other validation steps against the raw data. revision: yes

Circularity Check

0 steps flagged

No circularity: empirical qualitative study with direct data grounding

full rationale

The paper presents a user study with 24 participants comparing three instructional conditions in engineering mechanics via thematic analysis of self-reported feedback. No equations, fitted parameters, predictions, derivations, or first-principles claims exist. Conclusions rest directly on collected participant data without reduction to self-citations, ansatzes, or renamed inputs. The central claim (value of multimodal experiences) follows from the reported themes rather than being equivalent to its inputs by construction. This is a standard empirical design with no load-bearing circular steps.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The paper is an empirical HCI user study relying on standard qualitative methods rather than new mathematical constructs or postulated entities.

axioms (1)

domain assumption Thematic analysis of participant feedback reliably identifies meaningful patterns in learning experiences across instructional modalities.
This assumption underpins the extraction of design guidelines from the study data.

pith-pipeline@v0.9.1-grok · 5651 in / 1090 out tokens · 25755 ms · 2026-07-02T06:11:53.746412+00:00 · methodology

0 comments

read the original abstract

This study examined students' experiences with mixed-reality applications and physical toolkits in Engineering Mechanics to inform design guidelines for educational tools. In a user study with 24 participants, we compared classroom instruction alone, classroom instruction with a mixed-reality application, and classroom instruction with physical toolkits. Thematic analysis of participant feedback revealed that learners' workflows and engagement with fundamental mechanics problems varied across instructional modalities. Participants valued multimodal and interactive experiences that combined visualization with hands-on interaction, while reporting challenges with complex or unclear visualizations. These insights support the human-centered design of mixed-reality and physical tools for engineering education.

discussion (0)

Reference graph

Works this paper leans on

2 extracted references · 2 canonical work pages

[1]

https://doi.org/10.3390/info16010035 Gregg, A., Cortes, D., Osunbunmi, I., Pauley, L., & Lee, M. (2024). Designing and Evaluating Virtual Reality Applications for a Machine Design Course. 2024 ASEE Annual Conference & Exposition Proceedings, 47139. https://doi.org/10.18260/1-2--47139 Häfner, P., Häfner, V., & Ovtcharova, J. (2013). Teaching Methodology fo...

work page doi:10.3390/info16010035 2024
[2]

https://doi.org/10.1109/ESAIC.2018.00086 Syed, Z., Wang, T., Frady, K., Chalil Madathil, K., Bertrand, J., Hartley, R., Wagner, J., & Gramopadhye, A. (2017). Use of Virtual Reality Tools in an Undergraduate Mechanical Engineering Manufacturing Course. 2017 ASEE Annual Conference & Exposition Proceedings, 29067. https://doi.org/10.18260/1-2--29067 Terry, G...

work page doi:10.1109/esaic.2018.00086 2018

[1] [1]

https://doi.org/10.3390/info16010035 Gregg, A., Cortes, D., Osunbunmi, I., Pauley, L., & Lee, M. (2024). Designing and Evaluating Virtual Reality Applications for a Machine Design Course. 2024 ASEE Annual Conference & Exposition Proceedings, 47139. https://doi.org/10.18260/1-2--47139 Häfner, P., Häfner, V., & Ovtcharova, J. (2013). Teaching Methodology fo...

work page doi:10.3390/info16010035 2024

[2] [2]

https://doi.org/10.1109/ESAIC.2018.00086 Syed, Z., Wang, T., Frady, K., Chalil Madathil, K., Bertrand, J., Hartley, R., Wagner, J., & Gramopadhye, A. (2017). Use of Virtual Reality Tools in an Undergraduate Mechanical Engineering Manufacturing Course. 2017 ASEE Annual Conference & Exposition Proceedings, 29067. https://doi.org/10.18260/1-2--29067 Terry, G...

work page doi:10.1109/esaic.2018.00086 2018