EgoPressDiff is a multimodal video diffusion framework that generates UV-pressure maps from egocentric visual inputs using PoseNet, Vertex Encoder, and a Distribution-Calibrated Spatial Layer, reporting over 34% relative Volumetric IoU improvement on the EgoPressure dataset.
EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Estimating hand-surface contact pressure from an egocentric view is crucial for AR/VR devices, robotic imitation, and ergonomic analysis. Existing methods often discretize pressure signal and process frames independently, leading to quantization errors and temporal inconsistencies. We present \emph{EgoPressDiff}, a conditional video diffusion framework that generates UV-pressure maps from visual input. The core of our approach is a multi-modal conditioning strategy, introducing a PoseNet and a Vertex Encoder to efficiently extract features from hand pose and 3D mesh vertices. These signals, along with depth information, guide the generative process to ensure the pressure fields are physically grounded. To effectively fuse these heterogeneous features, we further propose a Distribution-Calibrated Spatial Layer, which aligns their statistical properties before combination. Evaluated on the EgoPressure ego-view setting, EgoPressDiff achieves state-of-the-art results, improving Volumetric IoU by over 34\% relative to prior baseline, while reducing MAE and maintaining high temporal accuracy. Our project page is at https://egopressdiff.github.io/.
fields
cs.CV 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation
EgoPressDiff is a multimodal video diffusion framework that generates UV-pressure maps from egocentric visual inputs using PoseNet, Vertex Encoder, and a Distribution-Calibrated Spatial Layer, reporting over 34% relative Volumetric IoU improvement on the EgoPressure dataset.