REVIEW 2 major objections 6 minor 29 references
In-bed Pressure-based Pose Estimation using Image Space Representation Learning
T0 review · 2 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read A learned preprocessing network converts vague in-bed pressure maps into camera-like images, letting a frozen pose estimator reach 95.8% detection.
desk verdict A clever preprocessor idea whose reported gains rest entirely on unreleased, author-made keypoint labels—so the numbers are conditional, but the approach deserves referee time. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The mechanism that carries the argument is PolishNet, a fully convolutional hourglass-shaped encoder-decoder that acts as a learned preprocessor. It maps a $W \times H \times 3$ pressure input $I$ to a polished image $I'$, and is trained end-to-end while the pose estimator's parameters stay frozen. The training objective is $E(\theta_P) = \lambda_{heatmap} E_{heatmap} + \lambda_{PAF} E_{PAF} + \lambda_{pixel} E_{pixel}$, where the heatmap and part-affinity-field terms push the polished image to produce correct keypoint beliefs and limb connections, and the pixel term keeps the polished image close to the original pressure map. Because the pose estimator is frozen, these task losses can only be reduced by making the polished image lie on the pose estimator's input manifold, which is what reconstructs missing body parts and lets the same front end serve other pose estimators.
What would settle it
Re-annotate a random subset of the automatically propagated frames by hand and recompute detection rates on the hand labels; if the 95.8% figure drops substantially, the headline result is an artifact of label propagation rather than PolishNet's reconstructions.
Extended reading notes
Core claim
On its own terms, the paper's central discovery is that ambiguous pressure maps can be converted into a representation that a pre-trained image-based pose estimator treats as ordinary input, and that this conversion is learnable from a small annotated dataset. The proposed PolishNet is a fully convolutional hourglass encoder-decoder trained with three losses: pixel error to preserve the pressure map's structure, heatmap error to place keypoints correctly, and part-affinity-field error to connect limbs correctly. Because the pose estimator's weights stay frozen, the only way for PolishNet to reduce the latter two losses is to synthesize images with complete, recognizable body parts, including low-pressure regions such as wrists, head, and knees. The paper reports this reconstruction effect qualitatively and quantitatively: a 95.8% average detection rate under leave-one-subject-out validation, and transfer to a second pose estimator with an 80.9% rate, establishing that the polished images generalize beyond the specific detector used during training.
Load-bearing premise
Every accuracy number depends on the body-part labels that the authors created by manually annotating 1,000 pressure maps and then propagating to all other frames under the assumption that each subject repeats almost the same posture; if those labels are wrong, the reported detection rates are inflated.
Editorial extensions
If this is right
- Average keypoint detection on the public pressure dataset rises from 47.7% with the pose estimator alone to 95.8% with PolishNet in front of it.
- Body parts with weak pressure signatures, such as wrists, head, and knees, show the largest improvements because PolishNet reconstructs them before pose estimation.
- The trained front end transfers to a different, unseen pose estimator, lifting its average detection rate from 54.1% to 80.9% without retraining.
- The full pipeline needs only about ten training subjects, so it can be adapted to new sensing hardware more quickly than training a pose estimator from scratch.
- Reliable in-bed pose estimates at this accuracy make pressure-based sleep monitoring a practical alternative to camera-based monitoring in privacy-sensitive settings.
Reading between the lines
- (Inference) Beyond the paper, the same 'frozen vision model plus learned front end' recipe should apply to any sparse sensor that can be rendered as an image, such as floor pressure mats, car-seat occupancy sensors, or tactile skins, provided a small labeled set is available.
- (Inference) The appearance of clothing-like patches in the outputs suggests PolishNet is completing shape priors rather than only denoising; ablating the pixel-loss weight would reveal whether these hallucinations are necessary for the pose gains or are side effects.
- (Inference) One could test how far the transfer claim extends by pairing the same trained front end with newer pose estimators trained on different image distributions; the 80.9% result for a single alternative detector does not yet bound the generality.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces PolishNet, a fully-convolutional hourglass network that maps in-bed pressure maps to colorized images resembling natural photographs, so that a frozen off-the-shelf pose estimator (OpenPose) can localize body keypoints. Training minimizes a weighted combination of pixel-level mean squared error between input and polished image, heatmap mean squared error, and part-affinity-field mean squared error, with OpenPose kept fixed. Evaluated on the public PmatData pressure dataset with author-created keypoint annotations, the method raises the average PCK area under the curve from 47.7% (OpenPose only) to 95.8% (PolishNet+OpenPose), and a PolishNet pre-trained for OpenPose also improves DeeperCut from 54.1% to 80.9%.
Significance. If the reported numbers are reliable, the paper demonstrates a practical way to reuse strong camera-image pose estimators on a non-image modality by learning a preprocessing transformation, with low data requirements (10 subjects) and modularity across pose estimators. The explicit use of a frozen pose estimator and the cross-model transfer experiment are good practices. However, the evaluation rests entirely on self-created keypoint labels that are neither released nor independently validated, and the paper lacks a purpose-built pressure-map pose baseline; these issues currently limit the confidence in the central quantitative claims.
major comments (2)
- [Section 3.1, Tables 1 and 2] The annotation procedure is the sole source of ground truth for both training and evaluation, but it is described only briefly and without validation. The automatic propagation via sum-of-squared-errors image similarity assumes near-identical repeated postures; if manual labels contain systematic bias (e.g., placing a weak-pressure joint at a pressure centroid) or if propagation copies errors, the reported 95.8% detection rate and the heatmap/PAF losses in Eqs. (1)-(4) are affected. The authors should release the annotations, provide inter-annotator agreement or another independent check on a subset, and quantify the error introduced by the propagation rule.
- [Section 3.2] The experiments compare against OpenPose and DeeperCut operating directly on colorized pressure maps, but do not include a pose estimator trained directly on the pressure maps with the same labels. Without such a baseline, the substantial improvement could come from any trainable network that overfits the labels rather than from the image-space representation learning that is the paper's central contribution. Adding a heatmap-regression network (e.g., a small hourglass trained on the same pressure maps) would make the benefit of the PolishNet transformation concrete.
minor comments (6)
- [Section 3.2] The text refers to 'Table 3.2' but the intended table is Table 2.
- [Table 1] The keypoint names are ambiguous: 'Head & Neck' appears as a single column, while the text states 14 heatmaps including head and neck as separate keypoints. Please clarify the exact set of keypoints.
- [Section 3.2] The PCK area-under-the-curve is reported without specifying the threshold range; define the exact protocol.
- [Section 2] Only λ_pixel is tuned; report sensitivity of results to this hyperparameter.
- [Figure 3] References to specific columns ('row3, columns 3, 4, 8, 10, and 11') are hard to follow; consider highlighting the relevant panels.
- [Section 3.2] The paper says 'leave-one-subject-out' but the described protocol leaves two subjects out; this should be corrected for accuracy.
Circularity Check
No significant circularity: PolishNet is trained against external manual keypoint labels with a frozen OpenPose, and the reported gains are empirical rather than forced by construction.
full rationale
The paper's derivation chain is not circular. PolishNet is trained with a frozen OpenPose, and the losses in Eqs. (1)-(4) compare OpenPose's predictions on the polished image to externally annotated ground-truth heatmaps and PAF fields, not to OpenPose's own outputs on the input pressure map. The ground-truth labels are human-annotated (Section 3.1), so the training signal is independent of the pose estimator's predictions. The headline result, 95.8% vs. 47.7% average detection rate, is an empirical comparison on leave-out subjects against those same manual labels; optimizing the heatmap/PAF losses does not by construction guarantee the PCK numbers, and the improvement over OpenPose-only is a measured generalization effect. The additional experiment with DeeperCut (80.9%) provides further independent evidence that the learned preprocessing produces images usable by pose estimators not involved in training. The paper's self-citations (refs. [9], [10]) are contextual references to the authors' other smart-bed work and are not load-bearing for the pose-estimation claim. The only notable weakness is that the manual keypoint labels and annotation tool are not released, which is a reproducibility and data-provenance limitation, not a circularity: it affects external verification of the accuracy numbers but does not make the derivation equivalent to its inputs by definition.
Assumptions & free parameters
free parameters (1)
- lambda_pixel =
0.2
assumptions (4)
- standard math Backpropagation and standard deep learning training convergence (optimization assumptions).
- domain assumption Pressure maps contain sufficient information to localize body joints.
- domain assumption A frozen OpenPose, trained on natural images, provides a valid supervisory signal for training PolishNet.
- domain assumption Subjects repeat nearly identical postures within a recording session, justifying auto-propagation of manual labels.
Cite this review
Pith. "Pith review of In-bed Pressure-based Pose Estimation using Image Space Representation Learning." pith.science (2026). https://pith.science/paper/DJKR5UC5
@misc{pith2026190808919,
author = {Pith},
title = {Pith review of: In-bed Pressure-based Pose Estimation using Image Space Representation Learning},
year = {2026},
howpublished = {\url{https://pith.science/paper/DJKR5UC5}},
note = {Machine review of arXiv:1908.08919}
}
read the original abstract
Recent advances in deep pose estimation models have proven to be effective in a wide range of applications such as health monitoring, sports, animations, and robotics. However, pose estimation models fail to generalize when facing images acquired from in-bed pressure sensing systems. In this paper, we address this challenge by presenting a novel end-to-end framework capable of accurately locating body parts from vague pressure data. Our method exploits the idea of equipping an off-the-shelf pose estimator with a deep trainable neural network, which pre-processes and prepares the pressure data for subsequent pose estimation. Our model transforms the ambiguous pressure maps to images containing shapes and structures similar to the common input domain of the pre-existing pose estimation methods. As a result, we show that our model is able to reconstruct unclear body parts, which in turn enables pose estimators to accurately and robustly estimate the pose. We train and test our method on a manually annotated public pressure map dataset using a combination of loss functions. Results confirm the effectiveness of our method by the high visual quality in the generated images and the high pose estimation rates achieved.
Reference graph
Works this paper leans on
-
[1]
In-bed Pressure-based Pose Estimation using Image Space Representation Learning
INTRODUCTION Sleeping makes up a third of human’s life-span. As a re- sult of recent advances in science, sleep studies, especially data-driven techniques, have attracted many researchers to the field. Moreover, low-cost processing and monitoring systems have enabled the utilization of sleep-related technologies in smart homes and clinics, paving the way f...
work page Pith review arXiv 1908
-
[2]
PROPOSED METHOD Overview: Our goal is to learn a pre-processing step that re- ceives the pressure data as inputs and synthesizes images such that a pre-trained pose estimation module shows stable and accurate performance. In other words, the output data from the learner should lie on the data manifold used by the pose estimation module. Therefore, this le...
-
[3]
EXPERIMENT SETUP AND RESULTS 3.1. Data Preparation We used the PmatData dataset [6, 22] to train and test our pressure-based pose estimation approach. The pressure data have been recorded by the Force Sensitive Application (FSA) pressure mapping mattress. The mattress was equipped with 32× 64 sensors, 1 inch apart from each other. The recording was perfor...
-
[4]
CONCLUSIONS Deep pose estimators are capable of detecting users’ pose from natural images, while failing on data acquired from other devices such as pressure mapping systems, which are gaining popularity for health- and sleep-related research. In this pa- per, we addressed this issue by presenting a novel framework for in-bed pose estimation using an off-...
-
[5]
ACKNOWLEDGEMENTS The Titan XP GPU used for this research was donated by the NVIDIA Corporation
-
[6]
Guidelines for sleep studies in adults–a position statement of the australasian sleep association,
James A Douglas, Ching Li Chai-Coetzer, David McEvoy, Matthew T Naughton, Alister M Neill, Peter Rochford, John Wheatley, and Christopher Worsnop, “Guidelines for sleep studies in adults–a position statement of the australasian sleep association,” Sleep Med , vol. 36, no. Suppl 1, pp. S2–S22, 2017
work page 2017
-
[7]
Chul H Lee, Dong K Kim, So Y Kim, Chae-Seo Rhee, and Tae-Bin Won, “Changes in site of obstruction in obstructive sleep apnea patients according to sleep position: a dise study,” The Laryngoscope, vol. 125, no. 1, pp. 248–254, 2015
work page 2015
-
[8]
National pressure ulcer advisory panel’s updated pressure ulcer staging system,
Joyce Black, Mona Mylene Baharestani, Janet Cuddigan, Becky Dorner, Laura Edsberg, Diane Langemo, Mary Ellen Posthauer, Catherine Ratliff, George Taler, et al., “National pressure ulcer advisory panel’s updated pressure ulcer staging system,” Advances in Skin & Wound Care, vol. 20, no. 5, pp. 269–274, 2007
work page 2007
Show all 29 references
-
[9]
Bodypart localization for pressure ulcer preven- tion,
Jason J Liu, Ming-Chun Huang, Wenyao Xu, and Majid Sar- rafzadeh, “Bodypart localization for pressure ulcer preven- tion,” in Annual International Conference of the IEEE En- gineering in Medicine and Biology Society (EMBC), 2014, pp. 766–769
2014
-
[10]
Balance-based time-frequency features for discrimi- nation of young and elderly subjects using unsupervised meth- ods,
Abdul Q Javaid, Rishabh Gupta, Alex Mihalidis, and S Ali Etemad, “Balance-based time-frequency features for discrimi- nation of young and elderly subjects using unsupervised meth- ods,” in IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), 2017, pp. 453–456
2017
-
[11]
In-bed posture classification and limb identification,
Sarah Ostadabbas, Maziyar Baran Pouyan, Mehrdad Nourani, and Nasser Kehtarnavaz, “In-bed posture classification and limb identification,” in IEEE Biomedical Circuits and Systems Conference, 2014, pp. 133–136
2014
-
[12]
Self-supervised learning from multi-sensor data for sleep recognition,
Aite Zhao, Junyu Dong, and Huiyu Zhou, “Self-supervised learning from multi-sensor data for sleep recognition,” IEEE Access, 2020
2020
-
[13]
Bed posture classification for pressure ulcer preven- tion,
Rasoul Yousefi, Sarah Ostadabbas, Miad Faezipour, Masoud Farshbaf, Mehrdad Nourani, Lakshman Tamil, and Matthew Pompeo, “Bed posture classification for pressure ulcer preven- tion,” in IEEE Engineering in Medicine and Biology Society , 2011, pp. 7175–7178
2011
-
[14]
Deep multitask learning for pervasive bmi estimation and identity recognition in smart beds,
Vandad Davoodnia, Monet Slinowsky, and Ali Etemad, “Deep multitask learning for pervasive bmi estimation and identity recognition in smart beds,” Journal of Ambient Intelligence and Humanized Computing, pp. 1–15, 2020
2020
-
[15]
Identity and posture recognition in smart beds with deep multitask learning,
Vandad Davoodnia and Ali Etemad, “Identity and posture recognition in smart beds with deep multitask learning,” in IEEE International Conference on Systems, Man and Cyber- netics (SMC), 2019, pp. 3054–3059
2019
-
[16]
Neurokinect: a novel low-cost 3d video-eeg system for epileptic seizure motion quantification,
Jo ˜ao Paulo Silva Cunha, Hugo Miguel Pereira Choupina, Ana Patr ´ıcia Rocha, Jos ´e Maria Fernandes, Felix Achilles, Anna Mira Loesch, Christian V ollmar, Elisabeth Hartl, and So- heyl Noachtar, “Neurokinect: a novel low-cost 3d video-eeg system for epileptic seizure motion q...
2016
-
[17]
Effects of turning on skin-bed interface pressures in healthy adults,
Matthew J Peterson, Wilhelm Schwab, Johannes H Van Oost- rom, Nikolaus Gravenstein, and Lawrence J Caruso, “Effects of turning on skin-bed interface pressures in healthy adults,” Journal of Advanced Nursing , vol. 66, no. 7, pp. 1556–1564, 2010
2010
-
[18]
Prevention of pressure ulcers in the surgical patient,
Patina S Walton-Geer, “Prevention of pressure ulcers in the surgical patient,” Aorn Journal, vol. 89, no. 3, pp. 538–552, 2009
2009
-
[19]
Bodies at rest: 3d human pose and shape estimation from a pressure image using syn- thetic data,
Henry M Clever, Zackory Erickson, Ariel Kapusta, Greg Turk, Karen Liu, and Charles C Kemp, “Bodies at rest: 3d human pose and shape estimation from a pressure image using syn- thetic data,” in IEEE Conference on Computer Vision and Pat- tern Recognition (CVPR), 2020, pp. 6215–6224
2020
-
[20]
Deeply learned composi- tional models for human pose estimation,
Wei Tang, Pei Yu, and Ying Wu, “Deeply learned composi- tional models for human pose estimation,” in European Con- ference on Computer Vision (ECCV), 2018, pp. 190–206
2018
-
[21]
Multi-scale structure-aware network for human pose estima- tion,
Lipeng Ke, Ming-Ching Chang, Honggang Qi, and Siwei Lyu, “Multi-scale structure-aware network for human pose estima- tion,” arXiv preprint arXiv:1803.09894, 2018
2018 arXiv
-
[22]
Learning feature pyramids for human pose estimation,
Wei Yang, Shuang Li, Wanli Ouyang, Hongsheng Li, and Xi- aogang Wang, “Learning feature pyramids for human pose estimation,” in IEEE International Conference on Computer Vision (ICCV), 2017, pp. 1290–1299
2017
-
[23]
Realtime multi-person 2d pose estimation using part affin- ity fields,
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh, “Realtime multi-person 2d pose estimation using part affin- ity fields,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1302–1310, 2017
2017
-
[24]
Cascaded pyramid network for multi- person pose estimation,
Yilun Chen, Zhicheng Wang, Yuxiang Peng, Zhiqiang Zhang, Gang Yu, and Jian Sun, “Cascaded pyramid network for multi- person pose estimation,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 7103–7112
2018
-
[25]
Deepercut: A deeper, stronger, and faster multi-person pose estimation model,
Eldar Insafutdinov, Leonid Pishchulin, Bjoern Andres, Mykhaylo Andriluka, and Bernt Schiele, “Deepercut: A deeper, stronger, and faster multi-person pose estimation model,” in European Conference on Computer Vision (ECCV). Springer, 2016, pp. 34–50
2016
-
[26]
Arttrack: articulated multi-person tracking in the wild,
Eldar Insafutdinov, Mykhaylo Andriluka, Leonid Pishchulin, Siyu Tang, Evgeny Levinkov, Bjoern Andres, and Bernt Schiele, “Arttrack: articulated multi-person tracking in the wild,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 1293–1301
2017
-
[27]
PhysioBank, PhysioToolkit, and PhysioNet: com- ponents of a new research resource for complex physiologic signals,
Ary L. Goldberger, Luis A. N. Amaral, Leon Glass, Jeffrey M. Hausdorff, Plamen Ch. Ivanov, Roger G. Mark, Joseph E. Mi- etus, George B. Moody, Chung-Kang Peng, and H. Eugene Stanley, “PhysioBank, PhysioToolkit, and PhysioNet: com- ponents of a new research resource for complex...
2000
-
[28]
Articulated human detection with flexible mixtures of parts,
Yi Yang and Deva Ramanan, “Articulated human detection with flexible mixtures of parts,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 12, pp. 2878– 2890, 2013
2013
-
[29]
2d human pose estimation: New benchmark and state of the art analysis,
Mykhaylo Andriluka, Leonid Pishchulin, Peter Gehler, and Bernt Schiele, “2d human pose estimation: New benchmark and state of the art analysis,” inIEEE Conference on computer Vision and Pattern Recognition (CVPR), 2014, pp. 3686–3693
2014
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.