HoloLens 2 Research Mode as a Tool for Computer Vision Research
read the original abstract
Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
VOCA: Visual Odometry with Codec Awareness
VOCA is a causal stereo visual odometry system that achieves state-of-the-art performance on compressed streams by exploiting codec awareness.
-
Impact of Hand Impairment and Occlusions on Hand Pose Estimation Accuracy in Augmented Reality Applications
Hand pose estimation accuracy generalizes to hand-impaired populations from spinal cord injury with negligible effects from object occlusions.
-
The Monado SLAM Dataset for Egocentric Visual-Inertial Tracking
The Monado SLAM dataset supplies real egocentric visual-inertial sequences from VR headsets to fill gaps in existing VIO/SLAM benchmarks for difficult real-world scenarios.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.