REVIEW 21 cited by
SAMPart3D: Segment Any Part in 3D Objects
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
SAMPart3D: Segment Any Part in 3D Objects
read the original abstract
3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D knowledge distillation, achieving zero-shot 3D part segmentation. However, these methods are limited by their reliance on text prompts, which restricts the scalability to large-scale unlabeled datasets and the flexibility in handling part ambiguities. In this work, we introduce SAMPart3D, a scalable zero-shot 3D part segmentation framework that segments any 3D object into semantic parts at multiple granularities, without requiring predefined part label sets as text prompts. For scalability, we use text-agnostic vision foundation models to distill a 3D feature extraction backbone, allowing scaling to large unlabeled 3D datasets to learn rich 3D priors. For flexibility, we distill scale-conditioned part-aware 3D features for 3D part segmentation at multiple granularities. Once the segmented parts are obtained from the scale-conditioned part-aware 3D features, we use VLMs to assign semantic labels to each part based on the multi-view renderings. Compared to previous methods, our SAMPart3D can scale to the recent large-scale 3D object dataset Objaverse and handle complex, non-ordinary objects. Additionally, we contribute a new 3D part segmentation benchmark to address the lack of diversity and complexity of objects and parts in existing benchmarks. Experiments show that our SAMPart3D significantly outperforms existing zero-shot 3D part segmentation methods, and can facilitate various applications such as part-level editing and interactive segmentation.
Forward citations
Cited by 21 Pith papers
-
UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image
UnfoldArt uses multi-agent debate grounded in vision-language and video models to infer articulation parameters and reconstruct full 3D objects including occluded parts from text or image inputs.
-
UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image
UnfoldArt uses a two-round structured debate between high-level semantic agents and low-level parameter agents, grounded in generated video, to infer articulation and reconstruct full articulated 3D objects including ...
-
OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments
OP3DSG generates unified part-aware open-vocabulary 3D scene graphs via knowledge-guided detection, 3D fusion, and LLM-refined prior graphs, with a new UniGraph3D benchmark showing SOTA results for robotics tasks.
-
MeshTailor: Cutting Seams via Generative Mesh Traversal
MeshTailor is a mesh-native generative model that uses ChainingSeams serialization and a dual-stream transformer with pointer layers to trace coherent seams vertex-by-vertex on 3D surfaces.
-
MeshFM: 2D Features Are All You Need for 3D Shape Understanding
A feedforward network trained only on 2D foundation-model features predicts rotation-robust, general-purpose 3D mesh features that work zero-shot for segmentation, correspondence, and deformation.
-
EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning
An end-to-end 3D editing framework achieves high-fidelity local edits from coarse bounding boxes and 2D image prompts using region-aware loss reweighting and a large-scale parts-derived training dataset.
-
Harnessing Generative Image Models for Training-Free Primitive Shape Abstraction
Prompted generative image models plus classical superquadric fitting yield category-agnostic 3D primitive abstractions with the lowest Chamfer distance on HumanPrim and Toys4K using 5–9 parts.
-
Tac-DINO: Learning Vision-Tactile Features with Patch Alignment
Tac-DINO constructs a large tactile dataset and Vis-Tac Holographic Matching Benchmark, then proposes Vision-Tactile Patch Alignment (VTPA) methods that outperform non-aligned baselines on local-to-global feature matching.
-
PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding
PAR3D is a part-aware 3D-MLLM framework with ScenePart dataset, Part-Aware 3D Representation Learning, and Hierarchical Segmentation Query Generation to improve part-level 3D scene understanding.
-
Robust Prior-Guided Segmentation for Editable 3D Gaussian Splatting
A framework for robust 3D segmentation in editable Gaussian Splatting that combines SAM-HQ masks with prior-guided multiview-consistent label assignment to 3D Gaussians.
-
Creative Robot Tool Use by Counterfactual Reasoning
Robots discover causal tool features through VLM suggestions and physics-based counterfactual perturbations in simulation, then transfer manipulation skills via conditioned keypoint matching.
-
Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation
A new framework generates part-level animatable 3D Gaussian vehicles from images by adding modules for exclusive part ownership and kinematic joint/axis prediction.
-
Utonia: Toward One Encoder for All Point Clouds
Utonia pretrains one Point Transformer encoder jointly on indoor, outdoor, object, and video-lifted point clouds, and shows cross-domain transfer and downstream gains.
-
PatchAlign3D: Local Feature Alignment for Dense 3D Shape Understanding
A feed-forward 3D encoder aligning patch-level point-cloud features with part-name text embeddings achieves state-of-the-art zero-shot 3D part segmentation, surpassing multi-view rendering pipelines by large margins o...
-
PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Grounding
A two-stage framework that predicts per-part material properties from a single image and uses editable physics simulation to guide video generation.
-
Human-in-the-Loop Atlas-Based 3D Asset Segmentation for Interactive Content Workflows
A human-in-the-loop pipeline generates usable segmented 2D atlases from diverse 3D geometries by using greedy view selection, SAM 2 interactive segmentation, and UV back-projection, with recurring manual corrections n...
-
From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
The paper surveys 3D asset generation methods and organizes them around the full production pipeline to assess which outputs meet engine-level requirements for interactive applications.
-
STEP-Parts: Geometric Partitioning of Boundary Representations for Large-Scale CAD Processing
STEP-Parts produces tessellation-robust geometric part labels from STEP B-Reps by deterministic merging of same-primitive faces, enabling consistent supervision on 180k+ models.
-
S2AM3D: Scale-controllable Part Segmentation of 3D Point Clouds
S2AM3D combines multi-view 2D priors with 3D contrastive learning and a scale-aware decoder to deliver consistent, granularity-controllable part segmentation on point clouds, supported by a new dataset exceeding 100k samples.
-
T-FunS3D: Task-Driven Hierarchical Open-Vocabulary 3D Functionality Segmentation
T-FunS3D is a task-driven hierarchical method for open-vocabulary 3D functionality segmentation that constructs an open-vocabulary scene graph and applies vision-language models to achieve comparable accuracy with fas...
-
From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
The paper surveys 3D content generation literature using a taxonomy of asset types and production stages to evaluate progress toward engine-ready assets.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.