Pith. sign in

REVIEW 4 major objections 6 minor 1 cited by

ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusion

T0 review · 4 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read ScoreHOI claims that a score-guided diffusion optimizer with physical constraints reconstructs human-object interactions more accurately and far faster than Adam-based optimization, improving contact F-Score by 9% on BEHAVE.

desk verdict Solid diffusion-based HOI refinement with a contaminated evaluation: test-set-tuned hyperparameters make the headline 9% contact gain unsupported as stated. read the letter →

arxiv 2509.07920 v1 pith:T5JR7YFH submitted 2025-09-09 cs.CV

Ao Li , Jinpeng Liu , Yixuan Zhu , Yansong Tang This is my paper · ORCID
classification cs.CV
keywords human-objectinteractionreconstructionscore-guideddiffusionphysicalplausibilitycontactrefinementDDIMinversion3Dhumanmeshrecoverysingle-imageprior
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper sets out to show that a diffusion model can act as a high-quality optimizer for joint reconstruction of a human body and an interacting object from a single image. The proposed pipeline, ScoreHOI, inverts an initial regression estimate into a noisy latent, then runs DDIM sampling while steering each denoising step with physical constraints: human-object contact, object-floor contact, and penetration avoidance. A contact-driven iterative refinement loop updates the predicted contact masks between sampling rounds. The authors report that this approach outperforms previous optimization and regression methods, including a 9% relative improvement in contact F-Score on the BEHAVE benchmark, while running one to two orders of magnitude faster than Adam-based optimizers. This matters because physically plausible human-object reconstruction is seriously ill-posed from a single view, and existing optimizers either ignore image evidence or are too slow for practical use.

What carries the argument

The load-bearing mechanism is the modified noise-prediction update $\epsilon'_{\phi} = \epsilon_{\phi}(x_t, t, c) + \rho \sqrt{1-\alpha_t} \nabla_{x_t} L_P$, where $L_P$ combines human-object contact, object-floor contact, and penetration-penalty losses. To compute those gradients from a noisy latent, the method uses the DPS approximation $\nabla_{x_t} \log p(P|c, x_t) \approx \nabla_{x_t} \log p(P|c, \hat{x}_0(x_t))$, replacing the latent with its one-step denoised estimate $\hat{x}_0$ and differentiating the physical losses through it. An IG-Adapter cross-attention block injects image features and object-geometry features as conditions into the diffusion model, and the contact-driven iterative refinement updates the contact masks each outer loop using a trained contact predictor.

What would settle it

Measure the error between the one-step denoised estimate $\hat{x}_0(x_t)$ and the posterior mean obtained from a full DDIM sample at the same noise level ($\tau = 0.05$) on BEHAVE frames; if the error is large in regions where hands contact objects, the DPS approximation in Eq. (4) is miscalibrated and the 9% contact F-Score gain cannot be attributed to the diffusion prior alone.

Watch

Extended reading notes

Core claim

On its own terms, the paper's central discovery is that diffusion priors over human-object interaction parameters are strong enough to serve as the optimizer itself, not just a generative prior over point clouds. Starting from a coarse SMPL-H and object pose estimate, DDIM inversion maps the parameters into a noisy latent that carries the image evidence, and guided DDIM sampling with physical losses reshapes the estimate into a more accurate, physically plausible interaction. The contact masks, which determine where the human-object and object-floor penalties apply, are themselves iteratively refined during inference, and the ablations show this iterative contact update is responsible for a large share of the contact F-Score gain. The paper positions this as a controllable, efficient alternative to joint Adam-based optimization that keeps image-level features in the loop.

Load-bearing premise

The paper's guidance depends on the assumption that the one-step denoised estimate $\hat{x}_0(x_t)$ is accurate enough at the chosen noise level that physical-loss gradients computed through it pull the parameters toward the image; if that estimate is off, the guidance can push the reconstruction away from the image rather than toward it.

Editorial extensions

If this is right

  • If the central claim holds, single-image human-object reconstruction can be refined without per-sample Adam iteration, cutting inference time from roughly 0.0035–0.036 frames per second to 0.29–2.0 frames per second with equal or better accuracy.
  • Contact quality improves: the method raises contact F-Score by 9% relative on BEHAVE and boosts contact recall on InterCap from 0.432 to 0.590, meaning predicted contact regions align far better with ground truth.
  • The contact-driven iterative refinement is a necessary component: removing it drops contact F-Score from 0.609 to 0.577, showing that updating contact masks during sampling is what lets the physical penalties act on the right vertices.
  • The diffusion prior also functions without physical guidance, since the generation tests from intermediate noise levels produce plausible interactions; the guidance terms then correct rather than create the contact pattern.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same score-guided refinement loop could extend to hand-object or human-scene reconstruction, since it needs only a differentiable parametric model, a denoiser over the parameters, and contact/penetration losses.
  • Because the method requires a canonical template for each object and trains affordance features on known categories, its gains may not transfer to unseen object shapes; the paper itself flags this, so an object-agnostic template or per-instance shape module is the natural next step.
  • The DPS-style approximation in Eq. (4) is shared with other diffusion-guidance methods; annealing the noise level or using a consistency-model one-step estimator could make the physical guidance robust at higher $\tau$ and further improve contact recall.
  • On InterCap the method trades precision for recall (precision drops from 0.661 to 0.627 while recall rises from 0.432 to 0.590), so applications with asymmetric error costs would need to reweight the contact objectives.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper proposes ScoreHOI, a diffusion-based optimizer for single-image joint 3D human-object interaction reconstruction. An affordance-aware regressor produces initial SMPL-H body parameters and object pose; at inference, DDIM inversion maps this estimate into a noisy latent which is then denoised under score guidance augmented with physical constraints (human-object contact, object-floor contact, and penetration avoidance), with contact masks iteratively refined across N rounds. Experiments on BEHAVE and InterCap report improved chamfer distances and contact F-Score over CHORE, CONTHO, and PHOSA, along with much faster inference than Adam-based optimizers.

Significance. If the claims hold, the paper offers a timely and potentially useful contribution: a diffusion-based refinement loop that injects physical plausibility into human-object reconstruction without slow per-sample Adam optimization. The idea of combining a learned diffusion prior with differentiable physical guidance is well motivated, and the proposed contact-driven iterative refinement is a sensible mechanism for stabilizing contact prediction. Strengths include the clear system design, the efficiency comparison (Table 2), and the ablation study (Table 3) that decomposes contributions of the diffusion module, conditions, and guidance terms. However, the current evaluation protocol contains a load-bearing test-set selection issue and omits key hyperparameters, and the headline contact F-Score gain is partly a direct consequence of the optimized loss; these problems prevent the state-of-the-art claim from being accepted without revision.

major comments (4)
  1. [Section 4.3, Table 4 and Table 1] The optimization hyperparameters N, tau, and Delta t in Table 4 are selected on the BEHAVE test split, and the final 'Ours' row in Table 1 is reported on that same split. Section 4.3 states that 'the optimal results measured by chamfer-distance are selected to establish our baseline,' making the reported 9% contact F-Score improvement a selected optimum rather than an unbiased estimate of generalization. No validation split, error bars, or significance tests are provided. Please re-evaluate using a held-out validation split (or nested cross-validation) and report standard errors or confidence intervals for the main comparisons.
  2. [Eqs. (5)-(6), Sections 3.6 and 4.3] The physical guidance weights lambda_ho, lambda_of, lambda_pt in Eq. (5) and the guidance scale rho in Eq. (6) are never reported. These values directly control the strength of the contact, floor, and penetration losses and therefore the results in Tables 1 and 3, but the paper only lists N, tau, and Delta t in Section 4.3. Without these numbers the inference procedure is not reproducible, and the ablation study cannot be quantitatively interpreted. Please provide the exact values and a sensitivity analysis.
  3. [Eq. (5) and Section 4.1 (contact F-Score)] The evaluation's contact F-Score is computed by classifying human vertices within 5 cm of the object mesh, while the loss L_ho directly minimizes the Euclidean distance between human and object vertices at the predicted contact regions. Consequently, part of the reported 9% contact F-Score gain is a direct and expected consequence of the optimization objective, not an independent measure of improved physical plausibility. For a fairer assessment, report additional metrics that are not so directly optimized (e.g., chamfer distance alone, or contact F-Score evaluated after excluding vertices used in the contact loss), or otherwise quantify how much of the contact gain is attributable to the diffusion prior versus the explicit loss.
  4. [Section 3.2 and Table 1] The Table 1 comparison between ScoreHOI and CONTHO is not fully apples-to-apples because ScoreHOI uses a new affordance-aware regressor with Hand4Whole initialization and PointNeXt object features, whereas CONTHO uses its own regressor. The ablation 'w/o diffusion' in Table 3 shows the diffusion component helps within the authors' pipeline, but it does not establish that the reported improvement over CONTHO comes from the proposed optimizer rather than from the improved initial regressor. A head-to-head comparison that refines the same initial estimates with Adam and with ScoreHOI would directly attribute the gain to the proposed method.
minor comments (6)
  1. [Table 1] The InterCap CONTHO row is missing spacing in the numerical values ('5.96 9.500.6610.432 0.522'); please fix the formatting.
  2. [Algorithm 1, line 5] In the contact mask update line, 'object-to-human contact mask Mh' should be written as M_o (or M_oh) to match the notation {M_i}_{i in {h,o,f}} used elsewhere.
  3. [Supplementary Algorithm A] The loop header 'for t = tau to Delta t with step size Delta t' is ambiguous because the sampling proceeds from a larger tau down to Delta t; please write the loop as descending, e.g., 'for t = tau down to Delta t step -Delta t'.
  4. [Figure 5 caption] The caption says 'Bottom row: the ablation study of L_ho,' but the accompanying text and the described effect (penetration penalty) indicate the bottom row should refer to L_pt.
  5. [Section 3.6] The 'Hand4Whole framework' is not cited; please add the appropriate reference.
  6. [Section 4.3] The criterion 'optimal results measured by chamfer-distance' is not fully precise: it should state whether this is the sum of CD_human and CD_object, and it should acknowledge that the selected configuration (N=10, tau=50, Delta t=2) does not maximize contact F-Score in Table 4 (the tau=100 row gives 0.615), so the selection rule should be stated unambiguously.

Circularity Check

2 steps flagged · score 6.0 of 10

Partial circularity: hyperparameters are selected on the same BEHAVE test split used for the headline claim, and the contact F-Score metric is a thresholded version of the vertex distance minimized by L_ho.

  1. fitted input called prediction [Section 4.3 (Table 4) and Section 4.1/Table 1]
    "We conduct all ablation studies on the BEHAVE test split as a standard benchmark for fair comparison. ... The optimal results measured by chamfer-distance are selected to establish our baseline."

    The configuration N=10, tau=50, dt=2 is selected by evaluating on the BEHAVE test split (Table 4), and the same split's 'Ours' row is then reported in Table 1 as the method's performance. The headline 9% contact F-Score gain is therefore an in-sample selected optimum, not an independent out-of-sample prediction. The paper gives no validation split, standard errors, or significance tests, so the claimed superiority over CONTHO is statistically forced by the selection procedure rather than established by an unbiased evaluation.

  2. self definitional [Section 3.3 Eq. (5) L_ho and Section 4.1 evaluation metrics]
    "Human-Object Contact: L_ho = ||(M_h + M_o) ⊙ |V_h − V_o|||_2. The Euclidean distance between human mesh V_h and object mesh V_o at the predicted human contact regions M_h and object contact regions M_o should be ideally zero. ... We obtain a contact map by classifying human vertices within 5cm of the object mesh following [37]."

    The contact F-Score used as evidence of physical plausibility is defined by thresholding the same vertex-to-object distance that L_ho directly minimizes. Wherever the predicted contact masks overlap GT contact vertices, driving L_ho toward zero places those vertices within the 5cm threshold by construction, mechanically raising contact recall and F-Score. Thus part of the reported contact improvement is the optimization objective itself rather than independent confirmation of physical plausibility.

full rationale

The core inference procedure is not circular: the diffusion prior is trained on data, DDIM inversion/sampling is a standard generative loop, the DPS-style approximation in Eq. (4) is a stated assumption borrowed from external literature, and the physical guidance terms are explicit objectives rather than hidden redefinitions of the metrics. The self-citations in the paper are not load-bearing; they are ordinary prior-work references. The circularity is concentrated in the evaluation. First, the ablation and hyperparameter search are performed directly on the BEHAVE test split, and the same split is then used for the headline comparison, so the reported improvement is a test-set-selected result. Second, the contact metric is a thresholded version of the distance minimized by L_ho, so the contact F-Score gain is partly a definitional consequence of the optimization objective. These issues make the central empirical claim partially circular, although the method still contains independent components such as the diffusion prior, the IG-Adapter, and the contact-driven iterative refinement loop.

Assumptions & free parameters 7 free parameters · 4 assumptions · 0 invented entities

No new physical entities are introduced. The method's free parameters are optimization hyperparameters and loss weights, several unreported. The key assumptions are the DPS-style score approximation, known object templates, and transfer of affordance features.

free parameters (7)
  • lambda_ho = not reported
    Weight of human-object contact loss in Eq. (5); strength not given in the text.
  • lambda_of = not reported
    Weight of object-floor contact loss; not reported.
  • lambda_pt = not reported
    Weight of penetration avoidance loss; not reported.
  • rho (guidance scale) = not reported
    Scales physical guidance gradient in Eq. (6); not reported.
  • N (iterations) = 10
    Chosen via ablation on the BEHAVE test split (Table 4).
  • tau (noise level) = 50 in Table 4, stated 0.05 in Sec. 3.6
    Chosen via ablation on the BEHAVE test split; text inconsistency.
  • Delta t (DDIM step) = 2
    Chosen via ablation on the BEHAVE test split.
assumptions (4)
  • domain assumption Approximation in Eq. (4): ∇_xt log p(P|c,x_t) ≈ ∇_xt log p(P|c, x̂0(x_t))
    Borrowed from DPS; assumed valid at the noise levels used for physical guidance, but not proven or validated at different τ.
  • domain assumption Objects have known templates with canonical pose
    A coarse object template P_o is provided; acknowledged in the Conclusion that template-free unseen objects are not supported.
  • domain assumption Pretrained PointNeXt affordance features transfer from ModelNet40 to BEHAVE/InterCap objects
    The geometry condition c_G is extracted from a pretrained model; transfer is assumed but not demonstrated.
  • domain assumption Contact predictor and regressor from CONTHO are reused and reliable
    The contact masks and initial estimates are produced by modules trained following [37]; errors in these modules propagate.

how reviews work

0 comments
Cite this review

Pith. "Pith review of ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusion." pith.science (2026). https://pith.science/paper/T5JR7YFH

@misc{pith2026250907920,
  author       = {Pith},
  title        = {Pith review of: ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusion},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/T5JR7YFH}},
  note         = {Machine review of arXiv:2509.07920}
}
read the original abstract

Joint reconstruction of human-object interaction marks a significant milestone in comprehending the intricate interrelations between humans and their surrounding environment. Nevertheless, previous optimization methods often struggle to achieve physically plausible reconstruction results due to the lack of prior knowledge about human-object interactions. In this paper, we introduce ScoreHOI, an effective diffusion-based optimizer that introduces diffusion priors for the precise recovery of human-object interactions. By harnessing the controllability within score-guided sampling, the diffusion model can reconstruct a conditional distribution of human and object pose given the image observation and object feature. During inference, the ScoreHOI effectively improves the reconstruction results by guiding the denoising process with specific physical constraints. Furthermore, we propose a contact-driven iterative refinement approach to enhance the contact plausibility and improve the reconstruction accuracy. Extensive evaluations on standard benchmarks demonstrate ScoreHOI's superior performance over state-of-the-art methods, highlighting its ability to achieve a precise and robust improvement in joint human-object interaction reconstruction.

Figures

Figures reproduced from arXiv: 2509.07920 by the authors.

Figure 1
Figure 1. Comparison of current methods and the proposed ScoreHOI. (a) Optimization-based methods iteratively refine pre￾dicted outcomes with the physical objectives. (b) Regression￾based methods update predictions via a dual-branch forward pro￾cess. (c) Our ScoreHOI integrates a score-based denoising module that incorporates physical constraints during the sampling process. on the reconstruction of the human. This approach h… view at source ↗
Figure 2
Figure 2. The inference procedure of ScoreHOI. (a) Given the input image I the human and object segmented silhouette Sh, So and the object template Po, we initially extract the image feature F and estimate the SMPL and object parameters θ, β, Ro and to. (b) Employing a contact-driven iterative refinement strategy, we refine these parameters x through the execution of a DDIM inversion and guided sampling loop. During the sampl… view at source ↗
Figure 3
Figure 3. The overview of IG-Adapter. We introduce an IG￾Adapter designed to integrate the image feature guidance cI and the geometry feature guidance cG into the diffusion model. The incorporation of observational and geometric awareness enhances the controllability of the model during the inference process. backbone. For the preliminary estimation of SMPL-H pa￾rameters, we adopt the Hand4Whole framework. Regard￾ing the pre-… view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Qualitative comparisons on BEHAVE [2] and InterCap [23] benchmarks. Our ScoreHOI recovers accurate human and object meshes with plausible interaction patterns. Notably, given only a single monocular image, the reconstruction results of the previous methods often appear…
Figure 5
Figure 5. Figure 5: Qualitative results for ablation study. Upper row: the ablation study of Lho. The inclusion of contact guidance between the human and object significantly enhances the physical plausibility of the interactions. Bottom row: the ablation study of Lho. The absence of a pe…

Review history (2 revisions) →

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. CA-World: Multi-Object Counterfactual Alignment for Efficient Interactive-Ready Reconstruction

    cs.CV 2026-05 unverdicted novelty 4.0 of 10

    The paper's stated CA-World counterfactual claim is absent from the body, which instead describes the SAM3D-Phys pipeline for multi-object interactive reconstruction and simulation.

Reference graph

Works this paper leans on

76 extracted references · 68 canonical work pages · cited by 1 Pith paper

  1. [1]

    2D human pose estimation: New benchmark and state of the art analysis

    Mykhaylo Andriluka, Leonid Pishchulin, Peter Gehler, and Bernt Schiele. 2D human pose estimation: New benchmark and state of the art analysis. InCVPR, 2014. 2

    work page 2014

  2. [2]

    BEHA VE: Dataset and method for tracking human object in- teractions

    Bharat Lal Bhatnagar, Xianghui Xie, Ilya A Petrov, Cristian Sminchisescu, Christian Theobalt, and Gerard Pons-Moll. BEHA VE: Dataset and method for tracking human object in- teractions. InCVPR, 2022. 2, 5, 6, 7

    work page 2022

  3. [3]

    Contactgrasp: Functional multi-finger grasp synthesis from contact

    Samarth Brahmbhatt, Ankur Handa, James Hays, and Dieter Fox. Contactgrasp: Functional multi-finger grasp synthesis from contact. InIROS, 2019. 2

    work page 2019

  4. [4]

    Contactpose: A dataset of grasps with object contact and hand pose

    Samarth Brahmbhatt, Chengcheng Tang, Christopher D Twigg, Charles C Kemp, and James Hays. Contactpose: A dataset of grasps with object contact and hand pose. In ECCV, 2020. 2

    work page 2020

  5. [5]

    Long-term human motion pre- diction with scene context

    Zhe Cao, Hang Gao, Karttikeya Mangalam, Qi-Zhi Cai, Minh V o, and Jitendra Malik. Long-term human motion pre- diction with scene context. InECCV, 2020. 2

    work page 2020

  6. [6]

    Holistic++ scene understanding: Single-view 3d holistic scene parsing and human pose esti- mation with human-object interaction and physical common- sense

    Yixin Chen, Siyuan Huang, Tao Yuan, Siyuan Qi, Yixin Zhu, and Song-Chun Zhu. Holistic++ scene understanding: Single-view 3d holistic scene parsing and human pose esti- mation with human-object interaction and physical common- sense. InICCV, 2019. 2

    work page 2019

  7. [7]

    Diffusion posterior sampling for general noisy inverse problems.ICLR, 2023

    Hyungjin Chung, Jeongsol Kim, Michael T Mccann, Marc L Klasky, and Jong Chul Ye. Diffusion posterior sampling for general noisy inverse problems.ICLR, 2023. 3, 4

    work page 2023

  8. [8]

    Improving diffusion models for inverse prob- lems using manifold constraints.NeurIPS, 2022

    Hyungjin Chung, Byeongsu Sim, Dohoon Ryu, and Jong Chul Ye. Improving diffusion models for inverse prob- lems using manifold constraints.NeurIPS, 2022. 3

    work page 2022

Show all 76 references
  1. [9]

    Ganhand: Predicting human grasp affordances in multi-object scenes

    Enric Corona, Albert Pumarola, Guillem Alenya, Francesc Moreno-Noguer, and Gr ´egory Rogez. Ganhand: Predicting human grasp affordances in multi-object scenes. InCVPR,

  2. [10]

    Motionlcm: Real-time controllable motion generation via latent consistency model

    Wenxun Dai, Ling-Hao Chen, Jingbo Wang, Jinpeng Liu, Bo Dai, and Yansong Tang. Motionlcm: Real-time controllable motion generation via latent consistency model. InECCV,

  3. [11]

    Use the force, luke! learning to predict physical forces by simulating effects

    Kiana Ehsani, Shubham Tulsiani, Saurabh Gupta, Ali Farhadi, and Abhinav Gupta. Use the force, luke! learning to predict physical forces by simulating effects. InCVPR,

  4. [12]

    Three- dimensional reconstruction of human interactions

    Mihai Fieraru, Mihai Zanfir, Elisabeta Oneata, Alin-Ionut Popa, Vlad Olaru, and Cristian Sminchisescu. Three- dimensional reconstruction of human interactions. InCVPR,

  5. [13]

    Learning complex 3d human self-contact

    Mihai Fieraru, Mihai Zanfir, Elisabeta Oneata, Alin-Ionut Popa, Vlad Olaru, and Cristian Sminchisescu. Learning complex 3d human self-contact. InAAAI, 2021. 2

    2021

  6. [14]

    Distribution-aligned diffusion for human mesh recovery

    Lin Geng Foo, Jia Gong, Hossein Rahmani, and Jun Liu. Distribution-aligned diffusion for human mesh recovery. In ICCV, 2023. 2

    2023

  7. [15]

    Humans in 4D: Reconstructing and tracking humans with transformers

    Shubham Goel, Georgios Pavlakos, Jathushan Rajasegaran, Angjoo Kanazawa, and Jitendra Malik. Humans in 4D: Reconstructing and tracking humans with transformers. In ICCV, 2023. 1

    2023

  8. [16]

    Resolving 3d human pose ambigui- ties with 3d scene constraints

    Mohamed Hassan, Vasileios Choutas, Dimitrios Tzionas, and Michael J Black. Resolving 3d human pose ambigui- ties with 3d scene constraints. InICCV, 2019. 2

    2019

  9. [17]

    Populating 3d scenes by learning human-scene interaction

    Mohamed Hassan, Partha Ghosh, Joachim Tesch, Dimitrios Tzionas, and Michael J Black. Populating 3d scenes by learning human-scene interaction. InCVPR, 2021. 2

    2021

  10. [18]

    Learning joint reconstruction of hands and manipulated ob- jects

    Yana Hasson, Gul Varol, Dimitrios Tzionas, Igor Kale- vatykh, Michael J Black, Ivan Laptev, and Cordelia Schmid. Learning joint reconstruction of hands and manipulated ob- jects. InCVPR, 2019. 2

    2019

  11. [19]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. InCVPR,

  12. [20]

    Denoising diffu- sion probabilistic models.NeurIPS, 2020

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models.NeurIPS, 2020. 2, 3

    2020

  13. [21]

    Capturing and inferring dense full-body human-scene contact

    Chun-Hao P Huang, Hongwei Yi, Markus H ¨oschle, Matvey Safroshkin, Tsvetelina Alexiadis, Senya Polikovsky, Daniel Scharstein, and Michael J Black. Capturing and inferring dense full-body human-scene contact. InCVPR, 2022. 2

    2022

  14. [22]

    Diffusion- based generation, optimization, and planning in 3d scenes

    Siyuan Huang, Zan Wang, Puhao Li, Baoxiong Jia, Tengyu Liu, Yixin Zhu, Wei Liang, and Song-Chun Zhu. Diffusion- based generation, optimization, and planning in 3d scenes. InCVPR, 2023. 4

    2023

  15. [23]

    InterCap: Joint markerless 3D tracking of humans and objects in interaction

    Yinghao Huang, Omid Taheri, Michael J Black, and Dim- itrios Tzionas. InterCap: Joint markerless 3D tracking of humans and objects in interaction. InGCPR, 2022. 2, 5, 6, 7

    2022

  16. [24]

    Neuralho- fusion: Neural volumetric rendering under human-object in- teractions

    Yuheng Jiang, Suyi Jiang, Guoxing Sun, Zhuo Su, Kai- wen Guo, Minye Wu, Jingyi Yu, and Lan Xu. Neuralho- fusion: Neural volumetric rendering under human-object in- teractions. InCVPR, 2022. 2

    2022

  17. [25]

    End-to-end recovery of human shape and pose

    Angjoo Kanazawa, Michael J Black, David W Jacobs, and Jitendra Malik. End-to-end recovery of human shape and pose. InCVPR, 2018. 1

    2018

  18. [26]

    Grasp- ing field: Learning implicit representations for human grasps

    Korrawe Karunratanakul, Jinlong Yang, Yan Zhang, Michael J Black, Krikamol Muandet, and Siyu Tang. Grasp- ing field: Learning implicit representations for human grasps. In3DV, 2020. 2

    2020

  19. [27]

    Adam: A method for stochastic optimization

    Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. InICLR, 2014. 2, 6

    2014

  20. [28]

    Learning to reconstruct 3d human pose and shape via model-fitting in the loop

    Nikos Kolotouros, Georgios Pavlakos, Michael J Black, and Kostas Daniilidis. Learning to reconstruct 3d human pose and shape via model-fitting in the loop. InICCV, 2019. 1

    2019

  21. [29]

    Probabilistic modeling for human mesh recovery

    Nikos Kolotouros, Georgios Pavlakos, Dinesh Jayaraman, and Kostas Daniilidis. Probabilistic modeling for human mesh recovery. InICCV, 2021. 1

    2021

  22. [30]

    Controllable human-object interaction synthesis

    Jiaman Li, Alexander Clegg, Roozbeh Mottaghi, Jiajun Wu, Xavier Puig, and C Karen Liu. Controllable human-object interaction synthesis. InECCV, 2025. 4

    2025

  23. [31]

    Estimating 3d motion and forces of person-object interactions from monocular video

    Zongmian Li, Jiri Sedlar, Justin Carpentier, Ivan Laptev, Nicolas Mansard, and Josef Sivic. Estimating 3d motion and forces of person-object interactions from monocular video. InCVPR, 2019. 2

    2019

  24. [32]

    Plan, posture and go: Towards open-vocabulary text-to-motion generation

    Jinpeng Liu, Wenxun Dai, Chunyu Wang, Yiji Cheng, Yan- song Tang, and Xin Tong. Plan, posture and go: Towards open-vocabulary text-to-motion generation. InECCV, 2024. 2

    2024

  25. [33]

    SMPL: A skinned multi- person linear model.ACM TOG, 2015

    Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. SMPL: A skinned multi- person linear model.ACM TOG, 2015. 3

    2015

  26. [34]

    Dposer: Diffusion model as robust 3d human pose prior, 2024

    Junzhe Lu, Jing Lin, Hongkun Dou, Ailing Zeng, Yue Deng, Yulun Zhang, and Haoqian Wang. Dposer: Diffusion model as robust 3d human pose prior, 2024. 2

    2024

  27. [35]

    imapper: interaction-guided scene mapping from monocular videos.TOG, 2019

    Aron Monszpart, Paul Guerrero, Duygu Ceylan, Ersin Yumer, and Niloy J Mitra. imapper: interaction-guided scene mapping from monocular videos.TOG, 2019. 2

    2019

  28. [36]

    On self-contact and human pose

    Lea Muller, Ahmed AA Osman, Siyu Tang, Chun-Hao P Huang, and Michael J Black. On self-contact and human pose. InCVPR, 2021. 2

    2021

  29. [37]

    Joint reconstruction of 3d human and object via contact-based refinement transformer

    Hyeongjin Nam, Daniel Sungho Jung, Gyeongsik Moon, and Kyoung Mu Lee. Joint reconstruction of 3d human and object via contact-based refinement transformer. InCVPR,

  30. [38]

    Pytorch: An imperative style, high-performance deep learning library

    Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zem- ing Lin, Natalia Gimelshein, Luca Antiga, et al. Pytorch: An imperative style, high-performance deep learning library. NeurIPS, 2019. 5

    2019

  31. [39]

    Expressive body capture: 3d hands, face, and body from a single image

    Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed AA Osman, Dimitrios Tzionas, and Michael J Black. Expressive body capture: 3d hands, face, and body from a single image. InCVPR, 2019. 2, 3

    2019

  32. [40]

    Hoi-diff: Text-driven synthe- sis of 3d human-object interactions using diffusion models

    Xiaogang Peng, Yiming Xie, Zizhao Wu, Varun Jampani, Deqing Sun, and Huaizu Jiang. Hoi-diff: Text-driven synthe- sis of 3d human-object interactions using diffusion models. arXiv preprint arXiv:2312.06553, 2023. 4

    2023 arXiv

  33. [41]

    Pointnet++: Deep hierarchical feature learning on point sets in a metric space.NeurIPS, 2017

    Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas. Pointnet++: Deep hierarchical feature learning on point sets in a metric space.NeurIPS, 2017. 1

    2017

  34. [42]

    Pointnext: Revisiting pointnet++ with improved training and scaling strategies

    Guocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai, Hasan Hammoud, Mohamed Elhoseiny, and Bernard Ghanem. Pointnext: Revisiting pointnet++ with improved training and scaling strategies. InNeurIPS, 2022. 5, 1

    2022

  35. [43]

    Contact and human dynamics from monocular video

    Davis Rempe, Leonidas J Guibas, Aaron Hertzmann, Bryan Russell, Ruben Villegas, and Jimei Yang. Contact and human dynamics from monocular video. InECCV, 2020. 2

    2020

  36. [44]

    High-resolution image syn- thesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj¨orn Ommer. High-resolution image syn- thesis with latent diffusion models. InCVPR, 2022. 2

    2022

  37. [45]

    Em- bodied hands: Modeling and capturing hands and bodies to- gether.TOG, 2017

    Javier Romero, Dimitris Tzionas, and Michael J Black. Em- bodied hands: Modeling and capturing hands and bodies to- gether.TOG, 2017. 3

    2017

  38. [46]

    Pigraphs: learning interaction snapshots from observations.TOG, 2016

    Manolis Savva, Angel X Chang, Pat Hanrahan, Matthew Fisher, and Matthias Nießner. Pigraphs: learning interaction snapshots from observations.TOG, 2016. 2

    2016

  39. [47]

    Denois- ing diffusion implicit models.ICLR, 2021

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denois- ing diffusion implicit models.ICLR, 2021. 2, 3

    2021

  40. [48]

    Pseudoinverse-guided diffusion models for inverse problems

    Jiaming Song, Arash Vahdat, Morteza Mardani, and Jan Kautz. Pseudoinverse-guided diffusion models for inverse problems. InICLR, 2023. 3

    2023

  41. [49]

    Score-based generative modeling through stochastic differential equa- tions.ICLR, 2021

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Ab- hishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equa- tions.ICLR, 2021. 2, 3

    2021

  42. [50]

    Score-guided diffusion for 3d human recovery

    Anastasis Stathopoulos, Ligong Han, and Dimitris Metaxas. Score-guided diffusion for 3d human recovery. InCVPR,

  43. [51]

    Neural free-viewpoint performance rendering under complex human-object interactions

    Guoxing Sun, Xin Chen, Yizhang Chen, Anqi Pang, Pei Lin, Yuheng Jiang, Lan Xu, Jingyi Yu, and Jingya Wang. Neural free-viewpoint performance rendering under complex human-object interactions. InACM MM, 2021. 2

    2021

  44. [52]

    Black, and Dim- itrios Tzionas

    Omid Taheri, Nima Ghorbani, Michael J. Black, and Dim- itrios Tzionas. GRAB: A dataset of whole-body human grasping of objects. InECCV, 2020. 2

    2020

  45. [53]

    Attention is all you need

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. InNeurIPS, 2017. 5

    2017

  46. [54]

    Hierarchical memory for long video qa.arXiv preprint arXiv:2407.00603, 2024

    Yiqin Wang, Haoji Zhang, Yansong Tang, Yong Liu, Jiashi Feng, Jifeng Dai, and Xiaojie Jin. Hierarchical memory for long video qa.arXiv preprint arXiv:2407.00603, 2024. 2

    2024 arXiv

  47. [55]

    Holistic 3d human and scene mesh estimation from single view images

    Zhenzhen Weng and Serena Yeung. Holistic 3d human and scene mesh estimation from single view images. InCVPR,

  48. [56]

    3d shapenets: A deep representation for volumetric shapes

    Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Lin- guang Zhang, Xiaoou Tang, and Jianxiong Xiao. 3d shapenets: A deep representation for volumetric shapes. In CVPR, 2015. 1

    2015

  49. [57]

    Template free reconstruction of human- object interaction with procedural interaction generation

    Xianghui Xie, Bharat Lal Bhatnagar, Jan Eric Lenssen, and Gerard Pons-Moll. Template free reconstruction of human- object interaction with procedural interaction generation. In CVPR, 2024. 2

    2024

  50. [58]

    Template free reconstruction of human- object interaction with procedural interaction generation

    Xianghui Xie, Bharat Lal Bhatnagar, Jan Eric Lenssen, and Gerard Pons-Moll. Template free reconstruction of human- object interaction with procedural interaction generation. In CVPR, 2024. 2, 1

    2024

  51. [59]

    CHORE: Contact, human and object reconstruction from a single RGB image

    Xianghui Xie, Bharat Lal Bhatnagar, and Gerard Pons-Moll. CHORE: Contact, human and object reconstruction from a single RGB image. InECCV, 2022. 2, 4, 6, 7

    2022

  52. [60]

    Visibility aware human-object interaction tracking from sin- gle RGB camera

    Xianghui Xie, Bharat Lal Bhatnagar, and Gerard Pons-Moll. Visibility aware human-object interaction tracking from sin- gle RGB camera. InCVPR, 2023. 2, 4

    2023

  53. [61]

    Visibility aware human-object interaction tracking from sin- gle rgb camera

    Xianghui Xie, Bharat Lal Bhatnagar, and Gerard Pons-Moll. Visibility aware human-object interaction tracking from sin- gle rgb camera. InCVPR, 2023. 7

    2023

  54. [62]

    In- tertrack: Tracking human object interaction without object templates

    Xianghui Xie, Jan Eric Lenssen, and Gerard Pons-Moll. In- tertrack: Tracking human object interaction without object templates. 2024. 1

    2024

  55. [63]

    Omnicontrol: Control any joint at any time for human motion generation

    Yiming Xie, Varun Jampani, Lei Zhong, Deqing Sun, and Huaizu Jiang. Omnicontrol: Control any joint at any time for human motion generation. InICLR, 2024. 2

    2024

  56. [64]

    ViTPose: Simple vision transformer baselines for human pose estimation

    Yufei Xu, Jing Zhang, Qiming Zhang, and Dacheng Tao. ViTPose: Simple vision transformer baselines for human pose estimation. InNeurIPS, 2022. 5

    2022

  57. [65]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models, 2023

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models, 2023. 5

    2023

  58. [66]

    Human-aware object placement for visual environment reconstruction

    Hongwei Yi, Chun-Hao P Huang, Dimitrios Tzionas, Muhammed Kocabas, Mohamed Hassan, Siyu Tang, Justus Thies, and Michael J Black. Human-aware object placement for visual environment reconstruction. InCVPR, 2022. 2

    2022

  59. [67]

    Flash-vstream: Efficient real- time understanding for long video streams.arXiv preprint arXiv:2506.23825, 2025

    Haoji Zhang, Yiqin Wang, Yansong Tang, Yong Liu, Ji- ashi Feng, and Xiaojie Jin. Flash-vstream: Efficient real- time understanding for long video streams.arXiv preprint arXiv:2506.23825, 2025. 2

    2025 arXiv

  60. [68]

    Perceiving 3D human-object spatial arrangements from a single image in the wild

    Jason Y Zhang, Sam Pepose, Hanbyul Joo, Deva Ramanan, Jitendra Malik, and Angjoo Kanazawa. Perceiving 3D human-object spatial arrangements from a single image in the wild. InECCV, 2020. 1, 6, 7

    2020

  61. [69]

    Zhang, Sam Pepose, Hanbyul Joo, Deva Ramanan, Jitendra Malik, and Angjoo Kanazawa

    Jason Y . Zhang, Sam Pepose, Hanbyul Joo, Deva Ramanan, Jitendra Malik, and Angjoo Kanazawa. Perceiving 3d human-object spatial arrangements from a single image in the wild. InECCV, 2020. 2

    2020

  62. [70]

    Place: Proximity learning of articulation and con- tact in 3d environments

    Siwei Zhang, Yan Zhang, Qianli Ma, Michael J Black, and Siyu Tang. Place: Proximity learning of articulation and con- tact in 3d environments. In3DV, 2020. 2

    2020

  63. [71]

    Couch: Towards controllable human-chair interactions

    Xiaohan Zhang, Bharat Lal Bhatnagar, Sebastian Starke, Vladimir Guzov, and Gerard Pons-Moll. Couch: Towards controllable human-chair interactions. InECCV, 2022. 2

    2022

  64. [72]

    I’m hoi: Inertia-aware monocular capture of 3d human-object inter- actions

    Chengfeng Zhao, Juze Zhang, Jiashen Du, Ziwei Shan, Junye Wang, Jingyi Yu, Jingya Wang, and Lan Xu. I’m hoi: Inertia-aware monocular capture of 3d human-object inter- actions. InCVPR, 2024. 5, 6

    2024

  65. [73]

    On the continuity of rotation representations in neural networks

    Yi Zhou, Connelly Barnes, Jingwan Lu, Jimei Yang, and Hao Li. On the continuity of rotation representations in neural networks. InCVPR, 2019. 4

    2019

  66. [74]

    Dpmesh: Exploiting diffusion prior for occluded human mesh recovery

    Yixuan Zhu, Ao Li, Yansong Tang, Wenliang Zhao, Jie Zhou, and Jiwen Lu. Dpmesh: Exploiting diffusion prior for occluded human mesh recovery. InCVPR, 2024. 1, 2

    2024

  67. [75]

    In- starevive: One-step image enhancement via dynamic score matching

    Yixuan Zhu, Haolin Wang, Ao Li, Wenliang Zhao, Yansong Tang, Jingxuan Niu, Lei Chen, Jie Zhou, and Jiwen Lu. In- starevive: One-step image enhancement via dynamic score matching. InICLR, 2025. 3

    2025

  68. [76]

    Flowie: Efficient image enhancement via rectified flow

    Yixuan Zhu, Wenliang Zhao, Ao Li, Yansong Tang, Jie Zhou, and Jiwen Lu. Flowie: Efficient image enhancement via rectified flow. InCVPR, 2024. 3 ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusion Supplementary Material In this a...

    2024

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.