Pith. sign in

REVIEW 4 major objections 5 minor 20 references

Rethinking Accessible Prototyping Methods for Blind and Visually Impaired Passengers in Highly Automated Vehicles

T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This paper argues that accessible prototyping for blind and visually impaired passengers in highly automated vehicles works best when participants modify flexible physical prototypes rather than only building from scratch or testing fixed…

desk verdict Honest workshop paper with a sensible prototyping suggestion, but the Conclusion's 'show' overstates a confounded two-case comparison. read the letter →

arxiv 2507.18880 v1 pith:WIQMMW2J submitted 2025-06-05 cs.HC

Luca-Maxim Meinhardt , Enrico Rukzio This is my paper
classification cs.HC
keywords highlyautomatedvehiclesblindandvisuallyimpairedpeopleparticipatorydesignaccessibleprototypingsituationawarenesstactileinterfacesmultimodalco-design
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that the way prototyping sessions are set up for blind and visually impaired passengers in highly automated vehicles changes what designers learn. Comparing two of the authors' own workshops, it argues that open-ended building with tangible parts produces broad information needs but can constrain imagination to the provided materials, while testing ready-made low-fidelity prototypes produces detailed, feature-level feedback but leaves little room for truly new concepts. The authors conclude that future work should blend both approaches, starting with a modifiable prototype that participants can extend or reshape, even though this means more sessions. The stakes are practical: because automated vehicles may remove the sighted driver as a source of information, designers need reliable ways to elicit what non-visual interfaces should convey.

What carries the argument

The central instrument is the comparison of two participatory design formats: free construction from tangible components versus evaluation of fixed low-fidelity prototypes. The tangible components are 3D-printed pieces attachable to Velcro-covered boards, which let blind participants work with their hands and express spatial, tactile interface ideas; the ready-made prototypes are three low-fidelity exit-assistance concepts used to elicit focused critique. The argument is carried by the contrast in what each format does to the range and specificity of participant input, and by the proposed synthesis of a flexible prototype that participants can extend during the session. The target of both formats is situation awareness, the passenger's ongoing understanding of the traffic situation and the environment at the exit.

What would settle it

A controlled comparison of three workshop formats with larger groups would settle the claim: if a modifiable-prototype session does not generate more new design concepts than the fixed-example session, or does not yield feedback as detailed as the fixed-example session, the recommended middle path would lose its empirical basis. Alternatively, a field study in which interfaces built from workshop preferences fail to improve BVIPs' performance or trust during a simulated automated ride would falsify the underlying assumption that these workshops capture real needs.

Watch

Extended reading notes

Core claim

The central claim, stated in the paper's conclusion, is that early involvement of blind and visually impaired people (BVIPs) yields deep insights but can limit creativity if materials are too constrained, while starting with ready-made examples encourages direct feedback but hinders broad exploration. The paper grounds this in two procedures: a workshop in which four BVIPs used 3D-printed pieces on Velcro boards to construct their own tactile traffic-information interface (leading to the OnBoard display, later tested with fourteen BVIPs), and a workshop in which five BVIPs evaluated three provided low-fidelity prototypes for exiting an automated vehicle (leading to the multimodal PathFinder system, later tested with sixteen BVIPs). The authors' positive proposal is a third path: introduce a basic prototype and let participants modify it on the spot with attachable items, iterating over multiple sessions. They also argue that the resulting prototypes and workshop records should be shared openly so later projects do not rebuild the same systems from scratch.

Load-bearing premise

The load-bearing premise is that the nine self-selected workshop participants (four in the first workshop, five in the second) are representative enough of the broader blind and visually impaired population, and that what they said in the workshops predicts what would help them during real automated rides and exits.

Editorial extensions

If this is right

  • Researchers designing interfaces for highly automated vehicles should budget multiple participatory sessions per participant rather than a single ideation or testing session.
  • Starting prototypes should be designed to be modifiable on the spot with attachable elements, so participants can both react to a concrete design and create their own variations.
  • The set of materials offered in a co-creation session is itself a design decision, because it steers the space of ideas participants can express.
  • Prototypes and workshop documentation, including failures and fixes, should be shared openly so future projects can build on existing systems like OnBoard and PathFinder instead of recreating them.
  • Final systems produced through this combined approach should continue to be validated against auditory-only baselines, as the paper did with fourteen and sixteen BVIPs respectively.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A testable extension would be a three-arm workshop study comparing open-ended building, fixed-example testing, and modifiable-prototype sessions on measures of idea breadth and feedback specificity; the paper's recommendation predicts the third arm combines the strengths of the other two.
  • The same trade-off likely applies to participatory design for other assistive technologies beyond vehicle interfaces, so the modifiable-prototype protocol could be evaluated as a general accessible co-design technique.
  • Because the paper's evidence is qualitative and drawn from small samples, the comparative claim should be treated as a hypothesis about workshop structure rather than a settled effect until it is replicated with more participants.
  • The open-source sharing recommendation, if adopted widely, would require changes in how interactive system prototypes are evaluated and credited in human-computer interaction research, since they are currently treated as study props rather than reusable citable artifacts.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. This workshop paper reports lessons learned from two participatory design procedures conducted with blind and visually impaired participants (BVIPs) for designing non-visual interfaces in highly automated vehicles (HAVs). The first procedure (N=4) asked participants to express information needs and build tactile interface ideas from 3D-printed elements; the resulting insights informed a final system called OnBoard, later evaluated with N=14 participants. The second procedure (N=5) presented three initial low-fidelity prototypes for exiting HAVs, gathered individual and group feedback, and combined preferred features into a multimodal system called PathFinder, evaluated with N=16 participants. The paper compares the two approaches and argues that open-ended building yields deep insights but can constrain creativity, while ready-made prototypes elicit direct feedback but limit broad exploration; it recommends a blended approach using flexible, modifiable materials. The manuscript is a short position paper with qualitative, anecdotal evidence.

Significance. If read as a practical lessons-learned report, the paper offers a useful, honest account of two concrete participatory workshops with a population that is underrepresented in HAV interface research. The authors provide a clear description of the workshop setups, the materials used, and the resulting design directions, and they join a timely discussion on accessible prototyping methods. The recommendation to combine open-ended materials with modifiable example prototypes is plausible and actionable. However, the paper does not provide a controlled comparison or systematic qualitative analysis, so its significance as an empirical contribution is limited; its value lies in generating hypotheses and sharing practical experience rather than in demonstrating a causal trade-off between prototyping methods.

major comments (4)
  1. [Conclusion] The conclusion states that the two participatory design methods 'show' a trade-off between open-ended building and ready-made prototype testing, but the study design does not license this causal claim. The two workshops differ simultaneously in the design task (conveying traffic information during a ride vs. exiting in unfamiliar locations), in the materials provided (3D-printed Velcro pieces vs. three complete low-fidelity prototypes), and in the participant group (N=4 vs. N=5, with no overlap). Any observed difference in creativity or breadth of exploration could be caused by task difficulty, material affordances, participant background, or group dynamics. The manuscript should either explicitly reframe the conclusion as a hypothesis or set of lessons, or acknowledge the confounds and explain why the comparison is still informative.
  2. [Two Participatory Design Procedures; Reflections on Accessible Prototyping] The paper reports no systematic qualitative analysis of the workshop data. There is no coding scheme, no inter-rater reliability, no participant quotes, and no measurable definition of 'deep insights', 'creativity', or 'broad exploration'. The body appropriately hedges with 'Our experiences suggest', but the conclusion upgrades this to 'show'. If the authors wish to make a comparative claim, they must specify what data were collected (e.g., audio recordings, notes, artifacts), how they were analyzed, and on what evidence each lesson is based. Alternatively, they should clearly label the reflections as anecdotal and non-comparative.
  3. [Two Participatory Design Procedures] The follow-up evaluations of the final systems (N=14 and N=16) are mentioned only as citations. If these evaluations are intended to support the value of the participatory methods, the paper should report at least a brief summary of the relevant outcomes (e.g., performance, preference, or acceptance results) and explain how they validate the workshop lessons. As written, the evaluations are cited but not used as evidence, which weakens the implicit claim that the workshops led to effective designs.
  4. [Conclusion] The first clause of the concluding trade-off, 'early involvement of BVIPs yields deep insights but can limit creativity if materials are too constrained', conflates two distinct observations. In the first workshop, participants were involved early and provided broad information needs, but the creativity limitation is attributed solely to the provided 3D-printed elements; in the second workshop, participants were also involved early but given complete prototypes. The manuscript should clearly separate which workshop supports each clause and acknowledge that 'early involvement' is not the manipulated variable.
minor comments (5)
  1. [Acknowledge/footnote] In the footnote, 'Y okohama' contains an erroneous space; it should read 'Yokohama'.
  2. [Two Participatory Design Procedures] The text 'Pa thFinderwith N=16' should be 'PathFinder with N=16'; likewise, the system name 'Pa thFinder' elsewhere should be 'PathFinder'.
  3. [Reflections on Accessible Prototyping] The phrase 'Y et, we believe' should be 'Yet, we believe'.
  4. [Reflections on Accessible Prototyping] The phrase 'lego bricks' should be capitalized as 'LEGO bricks' when referring to the brand, or replaced with a generic term such as 'building blocks'.
  5. [Abstract] The abstract states 'We will outline how each workshop was set up'; in a finished paper, the present tense 'We outline' is more appropriate.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the workshop conclusions are direct qualitative observations, not derived from fitted parameters or load-bearing self-citations.

full rationale

This paper makes no predictive or formal derivational claims; its central conclusion is a qualitative comparison of two participatory design workshops. The conclusion ('Our two participatory design methods show that early involvement of BVIPs yields deep insights but can limit creativity if materials are too constrained, while starting with ready-made examples encourages direct feedback but hinders broad exploration') is supported by the directly reported workshop observations, not by a parameter fitted to a subset of data or by an imported uniqueness theorem. The self-citations [13,14] describe the authors' previous projects and provide context for the two workshops; the lessons learned are not justified by appeal to those citations. The skeptical concern that the comparison is confounded by different tasks, materials, and participant groups is an evidence-strength or validity issue, not a circularity issue, because the observed differences are not shown by construction to follow from the method choice. No equation, fitted variable, or self-referential definition is used to derive the results. Therefore no circular step is present.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

No free parameters or invented entities appear because the paper makes no quantitative or ontological claims. The axioms are domain assumptions about the validity of small qualitative workshops as evidence for design recommendations.

assumptions (3)
  • domain assumption Small participatory workshops with self-selected BVIP participants yield insights that generalize to the broader blind and visually impaired population.
    Lessons are drawn from N=4 and N=5 workshops; the paper reports no demographic spread or saturation analysis (Sections 'Two Participatory Design Procedures').
  • domain assumption Self-reported information needs and preferences expressed in short workshop tasks predict situation awareness needs during real HAV rides and exits.
    The final systems were evaluated in later studies [13,14], but this paper does not demonstrate that workshop preferences correspond to in-vehicle behavior.
  • domain assumption The provided prototyping materials, 3D-printed Velcro pieces and low-fidelity mockups, are adequate elicitation tools for non-visual interface concepts.
    Participants could only express ideas within the material set, a constraint the authors themselves identify as a creativity limit (Section 'Reflections on Accessible Prototyping').

how reviews work

0 comments
Cite this review

Pith. "Pith review of Rethinking Accessible Prototyping Methods for Blind and Visually Impaired Passengers in Highly Automated Vehicles." pith.science (2026). https://pith.science/paper/WIQMMW2J

@misc{pith2026250718880,
  author       = {Pith},
  title        = {Pith review of: Rethinking Accessible Prototyping Methods for Blind and Visually Impaired Passengers in Highly Automated Vehicles},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WIQMMW2J}},
  note         = {Machine review of arXiv:2507.18880}
}
read the original abstract

Highly Automated Vehicles (HAVs) can improve mobility for blind and visually impaired people (BVIPs). However, designing non-visual interfaces that enable them to maintain situation awareness inside the vehicle is a challenge. This paper presents two of our participatory design workshops that explored what information BVIPs need in HAVs and what an interface that meets these needs might look like. Based on the participants' insights, we created final systems to improve their situation awareness. The two workshops used different approaches: in the first, participants built their own low-fidelity prototypes; in the second, they evaluated and discussed the initial prototypes we provided. We will outline how each workshop was set up and share lessons learned about prototyping methods for BVIPs and how they could be improved.

Figures

Figures reproduced from arXiv: 2507.18880 by the authors.

Figure 1
Figure 1. During the first project [13], participants used 3D-printed elements to build and explain their own tactile interface designs that aim to convey traffic information. After the individual sessions to explore each prototype, we gathered all participants again for a group discussion about their interface preferences. From these sessions, we learned which prototype features were most useful and combined them into a sing… view at source ↗

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

20 extracted references · 16 canonical work pages

  1. [1]

    Roger Bennett, Rohini Vijaygopal, and Rita Kottasz

    work page

  2. [2]

    2020.Supporting people with vision impairments in automated vehicles: Challenge and opportunities

    Robin Brewer and Nicole Ellison. 2020.Supporting people with vision impairments in automated vehicles: Challenge and opportunities. Technical Report. University of Michigan, Ann Arbor, Transportation Research Institute. https://rosap.ntl.bts.gov/view/dot/56391

    work page 2020

  3. [3]

    Huff, Briana Posadas, Julia Woodward, Shaundra B

    Julian Brinkley, Earl W. Huff, Briana Posadas, Julia Woodward, Shaundra B. Daily, and Juan E. Gilbert

    work page

  4. [4]

    Daily, and Juan E

    Julian Brinkley, Brianna Posadas, Imani Sherman, Shaundra B. Daily, and Juan E. Gilbert. 2019. An Open Road Evaluation of a Self-Driving Vehicle Human–Machine Interface Designed for Visually Impaired Users.International Journal of Human–Computer Interaction35, 11 (2019), 1018–1032.DOI: http://dx.doi.org/10.1080/10447318.2018.1561787

    arXiv 2019

  5. [5]

    Exploring the Needs, Preferences, and Concerns of Persons with Visual Impairments Regarding Autonomous Vehicles.ACM Transactions on Accessible Computing13, 1 (2020), 1–34.DOI: http://dx.doi.org/10.1145/3372280

    doi:10.1145/3372280 2020

  6. [6]

    Fink, Stacy A

    Paul D.S. Fink, Stacy A. Doore, Xue (Shelley) Lin, Matthew Maring, Pu Zhao, Aubree Nygaard, Grant Beals, Richard R. Corey, Raymond J. Perry, Katherine Freund, Velin Dimitrov, and Nicholas A. Giudice. 2023c. The Autonomous Vehicle Assistant (AVA): Emerging Technology Design Supporting Blind and Visually Impaired Travelers in Autonomous Transportation.Inter...

    work page arXiv 2023

  7. [7]

    Julian Brinkley, Brianna Posadas, Julia Woodward, and Juan E. Gilbert. 2017. Opinions and Preferences of Blind and Low Vision Consumers Regarding Self-Driving Vehicles. InProceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, Amy Hurst, Leah Findlater, and Meredith Ringel Morris (Eds.). ACM, New Y ork, NY , USA, 290...

    arXiv 2017

  8. [8]

    Paul D. S. Fink, Velin Dimitrov, Hiroshi Y asuda, Tiffany L. Chen, Richard R. Corey, Nicholas A. Giudice, and Emily S. Sumner. 2023b. Autonomous is Not Enough: Designing Multisensory Mid-Air Gestures for Vehicle Interactions Among People with Visual Impairments. InProceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Asso...

    work page arXiv 2023

Show all 20 references
  1. [9]

    Paul D. S. Fink, Anas Abou Allaban, Omoruyi E. Atekha, Raymond J. Perry, Emily S. Sumner, Richard R. Corey, Velin Dimitrov, and Nicholas A. Giudice. 2023a. Expanded Situational Awareness Without Vision. InProceedings of the 2023 ACM/IEEE International Conference on Human-Robot...

    2023

  2. [10]

    Leona Holloway, Matthew Butler, and Kim Marriott

  3. [11]

    Paul D. S. Fink, H. Milne, A. Caccese, M. Alsamsam, J. Loranger, Mark Colley, and Nicholas A Giudice

  4. [12]

    Celina Kacperski, Florian Kutzner, and Tobias Vogel

  5. [13]

    Luca-Maxim Meinhardt, Maximilian Rück, Julian Zähnle, Maryam Elhaidary, Mark Colley, Michael Rietzler, and Enrico Rukzio. 2024. Hey, What’s Going On? Conveying Traffic Information to People with Visual Impairments in Highly Automated Vehicles: Introducing OnBoard.Proc. ACM Int...

    2024 doi

  6. [14]

    Luca-Maxim Meinhardt, Lina Wilke, Maryam Elhaidary, Julia von Abel, Paul Fink, Michael Rietzler, Mark Colley, and Enrico Rukzio. 2025. Light My Way: Developing and Exploring a Multimodal Interface to Assist People With Visual Impairments to Exit Highly Automated Vehicles. InPr...

    2025

  7. [15]

    Leona Holloway, Kim Marriott, Matthew Butler, and Samuel Reinders. 2019. 3D Printed Maps and Icons for Inclusion. InThe 21st International ACM SIGACCESS Conference on Computers and Accessibility, Jeffrey P . Bigham, Shiri Azenkot, and Shaun K. Kane (Eds.). ACM, New Y ork, NY ,...

    2019

  8. [17]

    Assistive technology(2024), 1–11.DOI: http://dx.doi.org/10.1080/17483107.2024.2317930

    Comparing autonomous vehicle acceptance of German residents with and without visual impairments.Disability and rehabilitation. Assistive technology(2024), 1–11.DOI: http://dx.doi.org/10.1080/17483107.2024.2317930

    2024

  9. [20]

    Parivash Ranjbar, Pournami Krishnan Krishnakumari, Jonas Andersson, and Maria Klingegård. 2022. Vibrotactile guidance for trips with autonomous vehicles for persons with blindness, deafblindness, and deafness.Transportation Research Interdisciplinary Perspectives15 (2022), 100...

    2022

  10. [2020]

    Transportation Research Part F: Traffic Psychology and Behaviour69 (2020), 13–27.DOI: http://dx.doi.org/10.1016/j.trf.2019.12.012

    Willingness of people who are blind to accept autonomous vehicles: An empirical investigation. Transportation Research Part F: Traffic Psychology and Behaviour69 (2020), 13–27.DOI: http://dx.doi.org/10.1016/j.trf.2019.12.012

    2020 doi

  11. [2022]

    InCHI Conference on Human Factors in Computing Systems, Simone Barbosa, Cliff Lampe, Caroline Appert, David A

    3D Printed Street Crossings: Supporting Orientation and Mobility Training with People who are Blind or have Low Vision. InCHI Conference on Human Factors in Computing Systems, Simone Barbosa, Cliff Lampe, Caroline Appert, David A. Shamma, Steven Drucker, Julie Williamson, and ...

  12. [2024]

    In16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’24)

    Accessible Maps for the Future of Inclusive Ridesharing. In16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’24). ACM, New Y ork, NY , USA.DOI: http://dx.doi.org/10.1145/3640792.3675736

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.