Reality Proxy replaces direct selection of physical objects in MR with AI-enriched, hand-placed abstract proxies that support skimming, multi-selection, filtering, and semantic grouping.
VisiMark: Characterizing and Augmenting Landmarks for People with Low Vision in Augmented Reality to Support Indoor Navigation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Landmarks are critical in navigation, supporting self-orientation and mental model development. Similar to sighted people, people with low vision (PLV) frequently look for landmarks via visual cues but face difficulties identifying some important landmarks due to vision loss. We first conducted a formative study with six PLV to characterize their challenges and strategies in landmark selection, identifying their unique landmark categories (e.g., area silhouettes, accessibility-related objects) and preferred landmark augmentations. We then designed VisiMark, an AR interface that supports landmark perception for PLV by providing both overviews of space structures and in-situ landmark augmentations. We evaluated VisiMark with 16 PLV and found that VisiMark enabled PLV to perceive landmarks they preferred but could not easily perceive before, and changed PLV's landmark selection from only visually-salient objects to cognitive landmarks that are more important and meaningful. We further derive design considerations for AR-based landmark augmentation systems for PLV.
citation-role summary
citation-polarity summary
fields
cs.HC 1years
2025 1verdicts
CONDITIONAL 1roles
other 1polarities
unclear 1representative citing papers
citing papers explorer
-
Reality Proxy: Fluid Interactions with Real-World Objects in MR via Abstract Representations
Reality Proxy replaces direct selection of physical objects in MR with AI-enriched, hand-placed abstract proxies that support skimming, multi-selection, filtering, and semantic grouping.