Pith. sign in

REVIEW 5 major objections 5 minor 2 cited by

GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency

T0 review · 5 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read GEAL claims that rendering sparse point clouds as multi-view depth images lets a frozen 2D foundation model teach a 3D branch to predict affordances that generalize to unseen objects and survive point-cloud corruption.

desk verdict Solid, honest incremental work with reusable benchmarks; the evidence is slightly oversold by test-set tuning and a thin corruption baseline set. read the letter →

arxiv 2412.09511 v1 pith:7C5JMH4Z submitted 2024-12-12 cs.CV

Dongyue Lu , Lingdong Kong , Tianxin Huang , Gim Hee Lee This is my paper · ORCID
classification cs.CV
keywords 3DaffordancelearningGaussiansplattingcross-modalconsistencyrobustnessbenchmarkspointcloudcorruptionfoundationmodelslanguage-guided
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that 3D affordance learning, which predicts where on an object to grasp, sit, pour, or open, can be made more general and stable by borrowing the semantic knowledge of 2D foundation models. It proposes a dual-branch architecture: sparse point clouds are turned into realistic depth views with 3D Gaussian splatting, a frozen 2D foundation model reads those views, and a consistency loss forces the 3D branch's features to agree with the 2D branch's features. The paper reports that this consistently outperforms prior methods on seen and unseen object categories and on two new corrupted-point-cloud benchmarks it introduces. If true, this would give robot systems a way to predict affordances on unfamiliar objects without extra 3D labels, and to keep working when sensor data is noisy.

What carries the argument

The load-bearing machinery is 3D Gaussian splatting used as a differentiable 3D-to-2D renderer: each point becomes a Gaussian with fixed covariance and opacity, the mean positions are the point coordinates, and depth maps are drawn from many viewpoints. The rendered views let a frozen 2D foundation model see the object; its features are projected back to 3D through the same splatting, and the consistency module compares them with the 3D branch's features using an L2 loss. A granularity-adaptive fusion module with gated noise-weighted aggregation combines multi-scale visual features and text-conditioned cross-attention so that the final affordance query can operate at different object-part scales.

What would settle it

Render the same object point clouds with progressively larger Gaussian covariance values and lower opacity, and check whether GEAL's margin over a 3D-only baseline shrinks as the depth views blur; if the margin persists even on visually broken renders, the claimed mechanism is not the rendered fidelity, and if it collapses, the premise is confirmed.

Watch

Extended reading notes

Core claim

The central claim is that a 3D point cloud can be mapped into the image domain by attaching a Gaussian primitive to every point, rendering depth maps from multiple viewpoints, and then using those views as inputs to a frozen large-scale 2D vision model. The 2D model's features are fused with text at multiple granularities through a granularity-adaptive fusion module, and a 2D-3D consistency alignment module renders the 3D branch's features back into the same 2D views and minimizes the difference between the two feature maps. This consistency loss is what transfers the 2D model's semantics and stability into the 3D branch. At test time only the 3D branch is used, so the extra cost is paid during training. The paper's evidence is that this outperforms existing affordance methods on the LASO and PIAD datasets, including on novel object-affordance pairs, and on the newly constructed PIAD-C and LASO-C corruption benchmarks across seven corruption types.

Load-bearing premise

The argument assumes that depth views rendered from a sparse point cloud by 3D Gaussian splatting, with hand-set covariance and opacity, are faithful enough that a frozen 2D vision model extracts useful semantics rather than artifacts from the rendering.

Editorial extensions

If this is right

  • If the central claim holds, 3D affordance models can inherit the generalization of large 2D models without needing large 3D affordance datasets, because the 2D branch is pretrained and frozen.
  • The two corruption benchmarks, PIAD-C and LASO-C, provide a standard way to measure whether future 3D affordance methods survive real-world point-cloud noise rather than only clean data.
  • Stability under seven corruption types (scale, jitter, rotation, local/global drop, local/global add) is a transferable property of the design, not a result of corruption-specific training, since the model is trained only on clean data.
  • Inference stays lightweight: after training, predictions use only the 3D branch, so robots can run the method on-device.
  • The framework only needs point clouds and language prompts, not paired demonstration images, which makes it applicable to existing 3D affordance datasets.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same rendering-plus-consistency recipe could transfer other 2D foundation-model capabilities, such as open-vocabulary part naming, object-state reasoning, or grasp suggestions, to 3D point clouds for manipulation tasks beyond affordance segmentation.
  • The paper averages results over five corruption severity levels; plotting performance against severity would show whether GEAL's advantage is uniform or concentrates at mild corruption, which the current tables do not reveal.
  • Because the 2D branch is frozen and trained on clean renders, the model's ceiling under severe corruption is likely set by the 2D backbone's own stability; fine-tuning or augmenting the 2D branch with corrupted renders is an untested extension that could raise that ceiling.
  • The paper itself notes that 'contain'-style internal affordances are hard to capture from surface point clouds, so the generalization gains are best understood as applying to surface affordances rather than all affordances.
  • The PIAD results depend on randomly reusing LASO questions as language annotations; a human-curated annotation set for PIAD would be a sterner test of the generalization claims, though the corruption-benchmark comparisons would likely be unaffected.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper proposes GEAL, a dual-branch 3D affordance learning framework that renders point clouds into depth views via 3D Gaussian splatting, extracts image features with a frozen DINOv2 backbone, and aligns 2D, 3D, and text features using a granularity-adaptive fusion module and a 2D-3D consistency loss. The method is evaluated on the PIAD and LASO datasets, and the authors introduce two new corruption benchmarks, PIAD-C and LASO-C, built from the Seen partitions of those datasets. The reported experiments show GEAL ahead of most baselines on most metrics on clean data and ahead of LASO on all corruption settings.

Significance. If the results hold, the work offers a practical recipe for transferring 2D foundation-model robustness to 3D affordance prediction, and the new corruption benchmarks would fill a real gap in the 3D affordance literature. The release of code and datasets is a concrete asset, and the dual-branch design with Gaussian-splatting-based 2D supervision is a reasonable and timely idea. However, the evidence for the abstract's 'consistently outperforms' claim is weakened by the absence of repeated-seed statistics, by the omission of IAGNet from the corruption comparisons, and by the lack of any ablation or diagnostic for the fixed Gaussian rendering parameters that the robustness mechanism depends on.

major comments (5)
  1. [Tables 1-6; Sec. 4.2] All results are reported from a single run, with no confidence intervals, standard deviations, or significance tests. Several reported margins are very small (e.g., PIAD Seen AUC 85.0 vs 84.9 in Table 1), and on LASO Seen in Table 2 GEAL is actually worse than LASO on AUC (86.7 vs 87.3), as it also is for Vase on PIAD Unseen in Table 10 (54.9 vs 58.1). The central claim of consistent superiority therefore is not statistically supported as written. Please report repeated-seed means with standard deviations, or paired tests, at least for the main tables and the corruption tables.
  2. [Sec. 3.1; Table 6; Eq. (8)] The Gaussian covariance Sigma and opacity alpha are manually fixed during training and are never ablated; Table 6 varies only rendering resolution, view count, and view-dependent prompts. Under Drop Global (which removes up to 75% of points) and Add Global/Local, a fixed Gaussian scale may produce depth views with holes or noise clusters that are uninformative to the frozen DINOv2 encoder. Without an ablation over Sigma/alpha, or a diagnostic showing that the rendered depth views remain informative under corruption, the Eq. (8) consistency loss may be aligning 3D features to arbitrary 2D features rather than transferring affordance knowledge. Please add this ablation or a quantitative rendered-depth quality analysis.
  3. [Tables 3-4; Sec. 4.2] The corruption benchmarks PIAD-C and LASO-C compare only GEAL against LASO. IAGNet, which is the strongest baseline on clean PIAD in Table 1, is absent from the corruption comparison, so the claim that GEAL is robust 'compared to existing methods' is not supported for the full baseline set. Please include IAGNet and, where feasible, the other PIAD baselines on the corruption benchmarks.
  4. [Sec. 3.4; Appendix A.2-A.3] Both PIAD-C and LASO-C are constructed from the Seen partition only. The abstract promises robustness across 'novel object categories,' but the corruption evaluation does not exercise the Unseen setting. Please evaluate the corruption benchmarks on the Unseen partitions as well, or explicitly restrict the robustness claim to seen categories.
  5. [Sec. 4.1; Appendix B.1] Because PIAD lacks language annotations, LASO questions are randomly assigned to PIAD affordance-object pairs. This is a synthetic testbed, and if some assigned questions are semantically mismatched, text-conditioned models such as GEAL and LASO are evaluated on partly arbitrary instructions. Please report the sensitivity of the PIAD results to the random assignment (for example, multiple assignment seeds or a manual validation subset) to demonstrate that the comparisons in Table 1 are stable.
minor comments (5)
  1. [Sec. 3.3, Eq. (9)] The prediction h2D_enh is declared to lie in R^N, but the 2D branch produces V x H x W predictions; the dimensions should be specified consistently for the 2D output.
  2. [Sec. 3.2] The text refers to 'CAM (Conisistency Alignment Module)' with a typo in 'Consistency'.
  3. [Eqs. (1) and (7)] Eq. (7) uses alpha_i for feature rendering, but Eq. (1) defines alpha_i as o_i G_i^{2D}; please clarify whether the same projected-Gaussian opacity schedule is applied to feature rendering and to color rendering.
  4. [Appendix E.3; Tables 7-8] The acknowledged limitation on internal affordances such as 'contain' is relevant to the corruption benchmarks, since many benchmark pairs are contain-type affordances; the paper does not analyze whether robustness differs by affordance type.
  5. [Table 6] The final configuration is r=112, V=12 with prompt, but the Seen row with r=224, V=14 is best on all four metrics; the text says this choice balances effectiveness and efficiency, yet no runtime or memory comparison is provided to justify it.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: GEAL's reported gains are evaluated on external datasets against published baselines, and the 2D-to-3D knowledge transfer is a genuine distillation pipeline rather than a definitional identity.

full rationale

The paper's derivation chain is self-contained with respect to circularity. The 2D branch is created by rendering depth maps from point clouds via Gaussian splatting (Eqs. 1-2), encoding them with a frozen DINOv2 backbone, and training against 2D affordance masks that are themselves renderings of the 3D ground truth; the 3D branch is then trained with a consistency loss (Eq. 8) that aligns 3D features to these 2D features. This is a standard distillation/consistency-training setup, not a case where the 'prediction' is defined to equal its input. The central claims are supported by comparisons on the external PIAD and LASO datasets (Tables 1-2) and by ablations (Tables 5-6). The only self-citation of note is reference [56] (PointCloud-C), whose corruption recipe is used to construct PIAD-C and LASO-C; this is an external, publicly released robustness benchmark, and the overlap with a co-author does not make the benchmark's evaluations circular. The unablated fixed Gaussian covariance and opacity are a potential robustness limitation, but they are an empirical configuration choice, not a circular derivation. No fitted parameter is renamed as a prediction, and no load-bearing claim reduces by construction to a prior self-citation.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The model is a learned system, so the ledger records hand-set design choices and domain assumptions rather than fitted physical constants. The main free parameters are the fixed Gaussian splatting configuration and the benchmark corruption severity levels; the main axioms are that synthetic depth renderings preserve semantics, that alpha-blended feature projection yields meaningful 2D-3D correspondences, and that PIAD language questions can be reused from LASO.

free parameters (3)
  • Gaussian covariance and opacity = not specified
    Section 3.1 states covariance and opacity are manually adjusted and kept fixed to preserve geometry; no values or validation protocol are given, and the rendered depth images are the only input to the 2D branch.
  • Rendering resolution, number of views, view-dependent prompt = r=112, V=12, prompt=on
    Table 6 sweeps these choices on PIAD Seen and Unseen test partitions and selects the configuration; this is tuning on test data rather than a held-out validation split.
  • Corruption severity levels = 5 levels per 7 corruptions
    Benchmark design choices in Sec. A.1 define severity ranges (e.g., sigma in {0.01, ..., 0.05}); these are hand-set and affect the reported robustness numbers.
assumptions (4)
  • domain assumption Depth renderings produced by 3D Gaussian splatting from a sparse point cloud preserve enough geometry and semantic cues for a 2D foundation model to extract useful affordance features.
    Invoked in Section 3.1 as motivation; the whole 2D branch rests on this, but no analysis or experiment isolates rendering fidelity.
  • domain assumption Regions in 2D and 3D that overlap after splatting should have similar feature embeddings, and enforcing this with L2 consistency transfers semantics from 2D to 3D.
    Section 3.2, Eq. (8); the consistency loss assumes correspondence via alpha-blended projection is semantically meaningful, which could fail under occlusions and corruptions.
  • ad hoc to paper Randomly reassigning LASO questions to PIAD pairs preserves the intended affordance semantics.
    Section 4.1 and Appendix B.1 state PIAD has no language annotations and questions are randomly selected from LASO; this is a convenience assumption that could weaken the language grounding in PIAD experiments.
  • domain assumption The seven atomic corruptions and severity levels are a representative proxy for real-world sensor noise.
    Section 3.4 and Sec. A.1; the benchmark validity claim rests on this, following PointCloud-C but not validated against real sensor data.

how reviews work

0 comments
Cite this review

Pith. "Pith review of GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency." pith.science (2026). https://pith.science/paper/7C5JMH4Z

@misc{pith2026241209511,
  author       = {Pith},
  title        = {Pith review of: GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/7C5JMH4Z}},
  note         = {Machine review of arXiv:2412.09511}
}
read the original abstract

Identifying affordance regions on 3D objects from semantic cues is essential for robotics and human-machine interaction. However, existing 3D affordance learning methods struggle with generalization and robustness due to limited annotated data and a reliance on 3D backbones focused on geometric encoding, which often lack resilience to real-world noise and data corruption. We propose GEAL, a novel framework designed to enhance the generalization and robustness of 3D affordance learning by leveraging large-scale pre-trained 2D models. We employ a dual-branch architecture with Gaussian splatting to establish consistent mappings between 3D point clouds and 2D representations, enabling realistic 2D renderings from sparse point clouds. A granularity-adaptive fusion module and a 2D-3D consistency alignment module further strengthen cross-modal alignment and knowledge transfer, allowing the 3D branch to benefit from the rich semantics and generalization capacity of 2D models. To holistically assess the robustness, we introduce two new corruption-based benchmarks: PIAD-C and LASO-C. Extensive experiments on public datasets and our benchmarks show that GEAL consistently outperforms existing methods across seen and novel object categories, as well as corrupted data, demonstrating robust and adaptable affordance prediction under diverse conditions. Code and corruption datasets have been made publicly available.

Figures

Figures reproduced from arXiv: 2412.09511 by the authors.

Figure 1
Figure 1. 3D affordance prediction under varied data noises. Given a textual prompt, previous methods like LASO [32] (right side of each example) exhibit reduced robustness across different corruption types. In contrast, our proposed method, GEAL (left side of each example), maintains high accuracy and generaliza￾tion across these challenging scenarios by effectively transferring knowledge from a large-scale pre-trained 2D fo… view at source ↗
Figure 2
Figure 2. (Left): Framework Overview. The proposed GEAL consists of two branches: 3D and 2D. The 2D branch is established through 3D Gaussian Splatting to leverage the generalization capabilities of large pre-trained 2D models (cf . 3.1). We then perform cross-modality alignment, including Granularity-Adaptive Visual-Textual Fusion and 2D-3D Consistency Alignment, to unify features from different modalities into a shared embe… view at source ↗
Figure 3
Figure 3. Illustration of the Granularity-Adaptive Fusion Mod￾ule, it consists of a Flexible Granularity Feature Aggregation mechanism (a) and a Text-Conditioned Visual Alignment mech￾anism (b), we take the 2D branch as an example. trolling the noise scale, and ϵ ∼ N (0, 1) is Gaussian noise. These weights balance the influence of each feature level, enabling affordance reasoning across different granularities. The fused feat… view at source ↗
Figures from the paper (5 more)
Figure 4
Figure 4. Figure 4: Qualitative comparisons between GEAL and LASO [32] on the PIAD [70] dataset. Top two rows display results on seen partition, while bottom two rows show results on unseen partition. Our method demonstrates strong generalization on both seen and unseen partitions. cf . s…
Figure 5
Figure 5. Figure 5: Visualization examples of the PIAD-C dataset. We show 7 corruption types across 5 severity levels. [PITH_FULL_IMAGE:figures/full_fig_p012_5.png]
Figure 6
Figure 6. Figure 6: Visualization examples of the LASO-C dataset. We show 7 corruption types across 5 severity levels. [PITH_FULL_IMAGE:figures/full_fig_p013_6.png]
Figure 7
Figure 7. Figure 7: Qualitative comparisons between GEAL and LASO [32] on the PIAD-C dataset, highlighting the superior robustness of our method on corrupted data. 17 [PITH_FULL_IMAGE:figures/full_fig_p017_7.png]
Figure 8
Figure 8. Figure 8: Qualitative comparisons between GEAL and LASO [32] on the PIAD dataset. 18 [PITH_FULL_IMAGE:figures/full_fig_p018_8.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SeqAfford: Sequential 3D Affordance Reasoning via Multimodal Large Language Model

    cs.CV 2024-12 conditional novelty 7.0 of 10

    SeqAfford combines a 3D multimodal large language model with special segmentation tokens to decompose complex instructions into ordered affordance masks, and the authors present a 180K-pair benchmark for this task.

  2. Zero-Shot 3D Visual Grounding from Vision-Language Models

    cs.CV 2025-05 conditional novelty 5.0 of 10

    SeeGround localizes objects in 3D scenes from natural language without 3D-specific training, using query-aligned rendered views and spatially enriched text fed to a 2D vision-language model.

Reference graph

Works this paper leans on

74 extracted references · 63 canonical work pages · cited by 2 Pith papers

  1. [1]

    Cross- modal learning for image-guided point cloud shape comple- tion

    Emanuele Aiello, Diego Valsesia, and Enrico Magli. Cross- modal learning for image-guided point cloud shape comple- tion. In Advances in Neural Information Processing Systems, pages 37349–37362, 2022. 6, 14

    work page 2022

  2. [2]

    Emerg- ing properties in self-supervised vision transformers

    Mathilde Caron, Hugo Touvron, Ishan Misra, Herv ´e J´egou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. Emerg- ing properties in self-supervised vision transformers. In IEEE/CVF International Conference on Computer Vision , pages 9650–9660, 2021. 2

    work page 2021

  3. [3]

    Imlovenet: Misaligned image-supported regis- tration network for low-overlap point cloud pairs

    Honghua Chen, Zeyong Wei, Yabin Xu, Mingqiang Wei, and Jun Wang. Imlovenet: Misaligned image-supported regis- tration network for low-overlap point cloud pairs. In ACM SIGGRAPH Conference Proceedings, pages 1–9, 2022. 6, 14

    work page 2022

  4. [4]

    Affordance grounding from demonstration video to target image

    Joya Chen, Difei Gao, Kevin Qinghong Lin, and Mike Zheng Shou. Affordance grounding from demonstration video to target image. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6799–6808, 2023. 2

    work page 2023

  5. [5]

    Learning to act properly: Predicting and explaining affordances from images

    Ching-Yao Chuang, Jiaman Li, Antonio Torralba, and Sanja Fidler. Learning to act properly: Predicting and explaining affordances from images. InIEEE/CVF Conference on Com- puter Vision and Pattern Recognition, pages 975–983, 2018. 1, 2

    work page 2018

  6. [6]

    Training agents with interactive reinforcement learning and contextual affordances

    Francisco Cruz, Sven Magg, Cornelius Weber, and Stefan Wermter. Training agents with interactive reinforcement learning and contextual affordances. IEEE Transactions on Cognitive and Developmental Systems, 8(4):271–284, 2016. 1

    work page 2016

  7. [7]

    STRAP: Structured Object Affordance Segmentation with Point Supervision

    Leiyao Cui, Xiaoxue Chen, Hao Zhao, Guyue Zhou, and Yixin Zhu. Strap: Structured object affordance segmentation with point supervision. arXiv preprint arXiv:2304.08492 ,

    work page Pith review arXiv

  8. [8]

    3d affordancenet: A benchmark for visual ob- ject affordance understanding

    Shengheng Deng, Xun Xu, Chaozheng Wu, Ke Chen, and Kui Jia. 3d affordancenet: A benchmark for visual ob- ject affordance understanding. In IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 1778– 1787, 2021. 2, 11

    work page 2021

Show all 74 references
  1. [9]

    Affordancenet: An end-to-end deep learning approach for object affordance detection

    Thanh-Toan Do, Anh Nguyen, and Ian Reid. Affordancenet: An end-to-end deep learning approach for object affordance detection. In IEEE International Conference on Robotics and Automation, pages 5882–5889, 2018. 2

    2018

  2. [10]

    Demo2vec: Reasoning object affordances from online videos

    Kuan Fang, Te-Lin Wu, Daniel Yang, Silvio Savarese, and Joseph J Lim. Demo2vec: Reasoning object affordances from online videos. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2139–2147, 2018. 1, 2

    2018

  3. [11]

    Gapartnet: Cross-category domain-generalizable object perception and manipulation via generalizable and actionable parts

    Haoran Geng, Helin Xu, Chengyang Zhao, Chao Xu, Li Yi, Siyuan Huang, and He Wang. Gapartnet: Cross-category domain-generalizable object perception and manipulation via generalizable and actionable parts. In IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, page...

    2023

  4. [12]

    Rlafford: End-to-end affor- dance learning for robotic manipulation

    Yiran Geng, Boshi An, Haoran Geng, Yuanpei Chen, Yaodong Yang, and Hao Dong. Rlafford: End-to-end affor- dance learning for robotic manipulation. In IEEE Interna- tional Conference on Robotics and Automation, pages 5880– 5886, 2023. 1

    2023

  5. [13]

    The ecological approach to visual percep- tion: classic edition

    James J Gibson. The ecological approach to visual percep- tion: classic edition. Psychology press, 2014. 1

    2014

  6. [14]

    One-shot transfer of affordance regions? affcorrs! In Con- ference on Robot Learning , pages 550–560

    Denis Hadjivelichkov, Sicelukwanda Zwane, Lourdes Agapito, Marc Peter Deisenroth, and Dimitrios Kanoulas. One-shot transfer of affordance regions? affcorrs! In Con- ference on Robot Learning , pages 550–560. PMLR, 2023. 2

    2023

  7. [15]

    Is your hd map constructor reliable under sensor corruptions? In Advances in Neural Informa- tion Processing Systems, 2024

    Xiaoshuai Hao, Mengchuan Wei, Yifan Yang, Haimei Zhao, Hui Zhang, Yi Zhou, Qiang Wang, Weiming Li, Lingdong Kong, and Jing Zhang. Is your hd map constructor reliable under sensor corruptions? In Advances in Neural Informa- tion Processing Systems, 2024. 3

    2024

  8. [16]

    Vi- sual affordance and function understanding: A survey

    Mohammed Hassanin, Salman Khan, and Murat Tahtali. Vi- sual affordance and function understanding: A survey. ACM Computing Surveys, 54(3):1–35, 2021. 1

    2021

  9. [17]

    Benchmarking neu- ral network robustness to common corruptions and perturba- tions

    Dan Hendrycks and Thomas Dietterich. Benchmarking neu- ral network robustness to common corruptions and perturba- tions. arXiv preprint arXiv:1903.12261, 2019. 3, 9

    1903 arXiv

  10. [18]

    Affordance transfer learning for human-object interaction detection

    Zhi Hou, Baosheng Yu, Yu Qiao, Xiaojiang Peng, and Dacheng Tao. Affordance transfer learning for human-object interaction detection. InIEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 495–504, 2021. 1

    2021

  11. [19]

    V oxposer: Composable 3d value maps for robotic manipulation with language models

    Wenlong Huang, Chen Wang, Ruohan Zhang, Yunzhu Li, Jiajun Wu, and Li Fei-Fei. V oxposer: Composable 3d value maps for robotic manipulation with language models. In Conference on Robot Learning , pages 540–562. PMLR,

  12. [20]

    3d gaussian splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimk ¨uhler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering. ACM Transactions on Graphics, 42 (4):139–1, 2023. 2, 3

    2023

  13. [21]

    Point cloud augmentation with weighted local transformations

    Sihyeon Kim, Sanghyeok Lee, Dasol Hwang, Jaewon Lee, Seong Jae Hwang, and Hyunwoo J Kim. Point cloud augmentation with weighted local transformations. In IEEE/CVF International Conference on Computer Vision , pages 548–557, 2021. 3, 9

    2021

  14. [22]

    Kingma and Jimmy Ba

    Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In International Conference for Learning Representations, 2015. 7

    2015

  15. [23]

    Robo3d: Towards robust and reliable 3d perception against corruptions

    Lingdong Kong, Youquan Liu, Xin Li, Runnan Chen, Wen- wei Zhang, Jiawei Ren, Liang Pan, Kai Chen, and Ziwei Liu. Robo3d: Towards robust and reliable 3d perception against corruptions. In IEEE/CVF International Conference on Computer Vision, pages 19994–20006, 2023. 2, 3, 9

    2023

  16. [24]

    Cottereau, and Wei Tsang Ooi

    Lingdong Kong, Shaoyuan Xie, Hanjiang Hu, Lai Xing Ng, Benoit R. Cottereau, and Wei Tsang Ooi. Robodepth: Robust out-of-distribution depth estimation under corruptions. In Advances in Neural Information Processing Systems , pages 21298–21342, 2023. 3

    2023

  17. [25]

    Learning human activities and object affordances from rgb-d videos

    Hema Swetha Koppula, Rudhir Gupta, and Ashutosh Sax- ena. Learning human activities and object affordances from rgb-d videos. International Journal of Robotics Research, 32 (8):951–970, 2013. 2

    2013

  18. [26]

    Regu- larization strategy for point cloud via rigidly mixed sample

    Dogyoon Lee, Jaeha Lee, Junhyeop Lee, Hyeongmin Lee, Minhyeok Lee, Sungmin Woo, and Sangyoun Lee. Regu- larization strategy for point cloud via rigidly mixed sample. 20 In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15900–15909, 2021. 3, 9

    2021

  19. [27]

    Locate: Localize and transfer object parts for weakly su- pervised affordance grounding

    Gen Li, Varun Jampani, Deqing Sun, and Laura Sevilla-Lara. Locate: Localize and transfer object parts for weakly su- pervised affordance grounding. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10922– 10931, 2023. 1, 2, 3

    2023

  20. [28]

    One-shot open affordance learning with foundation models

    Gen Li, Deqing Sun, Laura Sevilla-Lara, and Varun Jampani. One-shot open affordance learning with foundation models. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3086–3096, 2024. 2, 3, 4

    2024

  21. [29]

    G2l: Semantically aligned and uniform video grounding via geodesic and game theory

    Hongxiang Li, Meng Cao, Xuxin Cheng, Yaowei Li, Zhi- hong Zhu, and Yuexian Zou. G2l: Semantically aligned and uniform video grounding via geodesic and game theory. In IEEE/CVF International Conference on Computer Vision, pages 12032–12042, 2023. 2

    2023

  22. [30]

    Referring transformer: A one- step approach to multi-task visual grounding

    Muchen Li and Leonid Sigal. Referring transformer: A one- step approach to multi-task visual grounding. In Advances in Neural Information Processing Systems , pages 19652– 19664, 2021. 6, 14

    2021

  23. [31]

    Is your lidar placement optimized for 3d scene understanding? In Advances in Neural Information Process- ing Systems, 2024

    Ye Li, Lingdong Kong, Hanjiang Hu, Xiaohao Xu, and Xi- aonan Huang. Is your lidar placement optimized for 3d scene understanding? In Advances in Neural Information Process- ing Systems, 2024. 3

    2024

  24. [32]

    Laso: Language-guided affordance seg- mentation on 3d object

    Yicong Li, Na Zhao, Junbin Xiao, Chun Feng, Xiang Wang, and Tat-Seng Chua. Laso: Language-guided affordance seg- mentation on 3d object. In IEEE/CVF Conference on Com- puter Vision and Pattern Recognition , pages 14251–14260,

  25. [33]

    Gres: Gener- alized referring expression segmentation

    Chang Liu, Henghui Ding, and Xudong Jiang. Gres: Gener- alized referring expression segmentation. InIEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 23592–23601, 2023. 6, 14

    2023

  26. [34]

    Akb-48: A real-world ar- ticulated object knowledge base

    Liu Liu, Wenqiang Xu, Haoyuan Fu, Sucheng Qian, Qiao- jun Yu, Yang Han, and Cewu Lu. Akb-48: A real-world ar- ticulated object knowledge base. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14809– 14818, 2022. 2

    2022

  27. [35]

    Joint hand motion and interaction hotspots prediction from egocentric videos

    Shaowei Liu, Subarna Tripathi, Somdeb Majumdar, and Xi- aolong Wang. Joint hand motion and interaction hotspots prediction from egocentric videos. In IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 3282– 3292, 2022. 2

    2022

  28. [36]

    Roberta: A robustly optimized bert pretraining approach

    Yinhan Liu. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692, 364, 2019. 7

    1907 arXiv

  29. [37]

    Segment any point cloud sequences by distilling vision foundation models

    Youquan Liu, Lingdong Kong, Jun Cen, Runnan Chen, Wen- wei Zhang, Liang Pan, Kai Chen, and Ziwei Liu. Segment any point cloud sequences by distilling vision foundation models. In Advances in Neural Information Processing Sys- tems, pages 37193–37229, 2023. 2

    2023

  30. [38]

    Auc: a misleading measure of the performance of pre- dictive distribution models

    Jorge M Lobo, Alberto Jim ´enez-Valverde, and Raimundo Real. Auc: a misleading measure of the performance of pre- dictive distribution models. Global Ecology and Biogeogra- phy, 17(2):145–151, 2008. 7, 12

    2008

  31. [39]

    Phrase-based affordance detection via cyclic bi- lateral interaction

    Liangsheng Lu, Wei Zhai, Hongchen Luo, Yu Kang, and Yang Cao. Phrase-based affordance detection via cyclic bi- lateral interaction. IEEE Transactions on Artificial Intelli- gence, 4(5):1186–1198, 2023. 2

    2023

  32. [40]

    One-shot affordance detection

    Hongchen Luo, Wei Zhai, Jing Zhang, Yang Cao, and Dacheng Tao. One-shot affordance detection. arXiv preprint arXiv:2106.14747, 2021. 2

    2021 arXiv

  33. [41]

    Grounded affordance from exocentric view

    Hongchen Luo, Wei Zhai, Jing Zhang, Yang Cao, and Dacheng Tao. Grounded affordance from exocentric view. arXiv preprint arXiv:2208.13196, 2022. 2

    2022 arXiv

  34. [42]

    Learning affordance grounding from exocen- tric images

    Hongchen Luo, Wei Zhai, Jing Zhang, Yang Cao, and Dacheng Tao. Learning affordance grounding from exocen- tric images. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2252–2261, 2022. 1, 2

    2022

  35. [43]

    3d-sps: Single-stage 3d visual grounding via referred point progressive selection

    Junyu Luo, Jiahui Fu, Xianghao Kong, Chen Gao, Haibing Ren, Hao Shen, Huaxia Xia, and Si Liu. 3d-sps: Single-stage 3d visual grounding via referred point progressive selection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16454–16463, 2022. 6, 14

    2022

  36. [44]

    Object affordance based multimodal fusion for natural human-robot interaction

    Jinpeng Mi, Song Tang, Zhen Deng, Michael Goerner, and Jianwei Zhang. Object affordance based multimodal fusion for natural human-robot interaction. Cognitive Systems Re- search, 54:128–137, 2019. 2

    2019

  37. [45]

    Intention-related natural language grounding via object af- fordance detection and intention semantic extraction

    Jinpeng Mi, Hongzhuo Liang, Nikolaos Katsakis, Song Tang, Qingdu Li, Changshui Zhang, and Jianwei Zhang. Intention-related natural language grounding via object af- fordance detection and intention semantic extraction. Fron- tiers in Neurorobotics, 14:26, 2020. 2

    2020

  38. [46]

    Chang, Li Yi, Subarna Tripathi, Leonidas J

    Kaichun Mo, Shilin Zhu, Angel X. Chang, Li Yi, Subarna Tripathi, Leonidas J. Guibas, and Hao Su. Partnet: A large- scale benchmark for fine-grained and hierarchical part-level 3d object understanding. In IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, pages 9...

    2019

  39. [47]

    O2o-afford: Annotation-free large-scale object-object affordance learning

    Kaichun Mo, Yuzhe Qin, Fanbo Xiang, Hao Su, and Leonidas Guibas. O2o-afford: Annotation-free large-scale object-object affordance learning. In Conference on Robot Learning, pages 1666–1677. PMLR, 2022. 2

    2022

  40. [48]

    Affordance detection of tool parts from geomet- ric features

    Austin Myers, Ching L Teo, Cornelia Ferm ¨uller, and Yiannis Aloimonos. Affordance detection of tool parts from geomet- ric features. In IEEE International Conference on Robotics and Automation, pages 1374–1381, 2015. 2

    2015

  41. [49]

    Grounded human-object interaction hotspots from video

    Tushar Nagarajan, Christoph Feichtenhofer, and Kristen Grauman. Grounded human-object interaction hotspots from video. In IEEE/CVF International Conference on Computer Vision, pages 8688–8697, 2019. 2

    2019

  42. [50]

    Open-vocabulary af- fordance detection in 3d point clouds

    Toan Nguyen, Minh Nhat Vu, An Vuong, Dzung Nguyen, Thieu V o, Ngan Le, and Anh Nguyen. Open-vocabulary af- fordance detection in 3d point clouds. In IEEE/RSJ Interna- tional Conference on Intelligent Robots and Systems , pages 5692–5698, 2023. 2

    2023

  43. [51]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 2, 3, 4, 5, 7

    2023 arXiv

  44. [52]

    Pytorch: An imperative style, high-performance deep learning library

    Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems ,...

    2019

  45. [53]

    Pointnet++: Deep hierarchical feature learning on point sets in a metric space

    Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in Neural Information Processing Systems, 30, 2017. 3, 4, 5

    2017

  46. [54]

    Learning transferable visual models from natural language supervi- sion

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervi- sion. In International conference on machine learning, ...

    2021

  47. [55]

    Optimizing intersection-over-union in deep neural networks for image segmentation

    Md Atiqur Rahman and Yang Wang. Optimizing intersection-over-union in deep neural networks for image segmentation. In International Symposium on Visual Com- puting, pages 234–244, 2016. 7, 12

    2016

  48. [56]

    Benchmarking and analyzing point cloud robustness under corruptions

    Jiawei Ren, Lingdong Kong, Liang Pan, and Ziwei Liu. Benchmarking and analyzing point cloud robustness under corruptions. Preprint, 2022. 2, 6

    2022

  49. [57]

    Benchmarking and analyzing point cloud classification under corruptions

    Jiawei Ren, Liang Pan, and Ziwei Liu. Benchmarking and analyzing point cloud classification under corruptions. In In- ternational Conference on Machine Learning, pages 18559– 18575. PMLR, 2022. 2, 3, 9

    2022

  50. [58]

    A multi-scale cnn for affordance segmentation in rgb images

    Anirban Roy and Sinisa Todorovic. A multi-scale cnn for affordance segmentation in rgb images. In European con- ference on computer vision, pages 186–201. Springer, 2016. 2

    2016

  51. [59]

    Color indexing

    Michael J Swain and Dana H Ballard. Color indexing. Inter- national Journal of Computer Vision , 7(1):11–32, 1991. 7, 13

    1991

  52. [60]

    Mbdf-net: Multi-branch deep fusion network for 3d object detection

    Xun Tan, Xingyu Chen, Guowei Zhang, Jishiyu Ding, and Xuguang Lan. Mbdf-net: Multi-branch deep fusion network for 3d object detection. In International Workshop on Mul- timedia Computing for Urban Data , pages 9–17, 2021. 6, 14

    2021

  53. [61]

    A deep learning approach to object affordance segmen- tation

    Spyridon Thermos, Petros Daras, and Gerasimos Potami- anos. A deep learning approach to object affordance segmen- tation. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 2358–2362. IEEE, 2020. 2

    2020

  54. [62]

    Mlp-mixer: An all-mlp architecture for vision

    Ilya O Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lu- cas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, et al. Mlp-mixer: An all-mlp architecture for vision. Advances in Neural Information Processing Systems, 34:2...

  55. [63]

    Sample-adaptive augmentation for point cloud recognition against real-world corruptions

    Jie Wang, Lihe Ding, Tingfa Xu, Shaocong Dong, Xinli Xu, Long Bai, and Jianan Li. Sample-adaptive augmentation for point cloud recognition against real-world corruptions. In IEEE/CVF International Conference on Computer Vision, pages 14330–14339, 2023. 3, 9

    2023

  56. [64]

    Target- guided adversarial point cloud transformer towards recog- nition against real-world corruptions

    Jie Wang, Tingfa Xu, Lihe Ding, and Jianan Li. Target- guided adversarial point cloud transformer towards recog- nition against real-world corruptions. arXiv preprint arXiv:2411.00462, 2024. 3, 9

    2024 arXiv

  57. [65]

    Advantages of the mean absolute error (mae) over the root mean square error (rmse) in assessing average model performance

    Cort J Willmott and Kenji Matsuura. Advantages of the mean absolute error (mae) over the root mean square error (rmse) in assessing average model performance. Climate Research, 30(1):79–82, 2005. 7, 13

    2005

  58. [66]

    Benchmarking and im- proving bird’s eye view perception robustness in autonomous driving

    Shaoyuan Xie, Lingdong Kong, Wenwei Zhang, Jiawei Ren, Liang Pan, Kai Chen, and Ziwei Liu. Benchmarking and im- proving bird’s eye view perception robustness in autonomous driving. arXiv preprint arXiv:2405.17426, 2024. 2, 3

    2024 arXiv

  59. [67]

    Partafford: Part-level affordance discovery from 3d objects.arXiv preprint arXiv:2202.13519,

    Chao Xu, Yixin Chen, He Wang, Song-Chun Zhu, Yixin Zhu, and Siyuan Huang. Partafford: Part-level affordance discovery from 3d objects.arXiv preprint arXiv:2202.13519,

    arXiv

  60. [68]

    Pointfu- sion: Deep sensor fusion for 3d bounding box estimation

    Danfei Xu, Dragomir Anguelov, and Ashesh Jain. Pointfu- sion: Deep sensor fusion for 3d bounding box estimation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 244–253, 2018. 6, 14

    2018

  61. [69]

    Fusionrcnn: Lidar-camera fusion for two- stage 3d object detection.Remote Sensing, 15(7):1839, 2023

    Xinli Xu, Shaocong Dong, Lihe Ding, Jie Wang, Tingfa Xu, and Jianan Li. Fusionrcnn: Lidar-camera fusion for two- stage 3d object detection.Remote Sensing, 15(7):1839, 2023. 6, 14

    2023

  62. [70]

    Grounding 3d object affordance from 2d interactions in images

    Yuhang Yang, Wei Zhai, Hongchen Luo, Yang Cao, Jiebo Luo, and Zheng-Jun Zha. Grounding 3d object affordance from 2d interactions in images. In IEEE/CVF International Conference on Computer Vision, pages 10905–10915, 2023. 1, 2, 6, 7, 8, 11, 14, 15

    2023

  63. [71]

    Object affordance de- tection with relationship-aware network

    Xue Zhao, Yang Cao, and Yu Kang. Object affordance de- tection with relationship-aware network. Neural Computing and Applications, 32(18):14321–14333, 2020. 2

    2020

  64. [72]

    Convolution meets lora: Parameter effi- cient finetuning for segment anything model

    Zihan Zhong, Zhiqiang Tang, Tong He, Haoyang Fang, and Chun Yuan. Convolution meets lora: Parameter effi- cient finetuning for segment anything model. arXiv preprint arXiv:2401.17868, 2024. 4

    2024 arXiv

  65. [73]

    Perception-aware multi-sensor fusion for 3d lidar semantic segmentation

    Zhuangwei Zhuang, Rong Li, Kui Jia, Qicheng Wang, Yuan- qing Li, and Mingkui Tan. Perception-aware multi-sensor fusion for 3d lidar semantic segmentation. In IEEE/CVF In- ternational Conference on Computer Vision , pages 16280– 16290, 2021. 6, 14 22

    2021

  66. [2024]

    1, 2, 5, 6, 7, 8, 11, 14, 15, 16, 17, 18

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.