REVIEW 28 cited by
CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM
read the original abstract
This paper aims to design a unified Computer-Aided Design (CAD) generation system that can easily generate CAD models based on the user's inputs in the form of textual description, images, point clouds, or even a combination of them. Towards this goal, we introduce the CAD-MLLM, the first system capable of generating parametric CAD models conditioned on the multimodal input. Specifically, within the CAD-MLLM framework, we leverage the command sequences of CAD models and then employ advanced large language models (LLMs) to align the feature space across these diverse multi-modalities data and CAD models' vectorized representations. To facilitate the model training, we design a comprehensive data construction and annotation pipeline that equips each CAD model with corresponding multimodal data. Our resulting dataset, named Omni-CAD, is the first multimodal CAD dataset that contains textual description, multi-view images, points, and command sequence for each CAD model. It contains approximately 450K instances and their CAD construction sequences. To thoroughly evaluate the quality of our generated CAD models, we go beyond current evaluation metrics that focus on reconstruction quality by introducing additional metrics that assess topology quality and surface enclosure extent. Extensive experimental results demonstrate that CAD-MLLM significantly outperforms existing conditional generative methods and remains highly robust to noises and missing points. The project page and more visualizations can be found at: https://cad-mllm.github.io/
Forward citations
Cited by 28 Pith papers
-
FllumaOne: A Code-Native Multimodal CAD Dataset with Executable Programs and Kernel-Validated Feature Histories
FllumaOne releases 100,000 kernel-validated CAD models as executable Python programs with aligned multimodal data including feature histories and geometry exports.
-
BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding
BRepCLIP is the first contrastive pretraining framework that tokenizes BRep CAD geometry into surface and curve vocabularies and aligns the resulting embeddings with CLIP text and image encoders, reporting large gains...
-
UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD
UniCAD supplies a unified multi-modal benchmark and an end-to-end MLLM that performs reconstruction, generation, and QA on CAD data, reporting SOTA results on UniCAD and Fusion360.
-
MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
MUSE is a new benchmark and three-stage evaluation protocol for text-to-CAD generation that assesses functionality, manufacturability, and assemblability of B-Rep assemblies beyond geometric similarity.
-
BrepForge: Factorized B-rep Synthesis via Wireframe Composition and Boundary-Conditioned Surface Instantiation
BrepForge factorizes B-rep synthesis into face-aware autoregressive wireframe composition followed by boundary-conditioned surface instantiation using learning-free geometric priors.
-
Img2CADSeq: Image-to-CAD Generation via Sequence-Based Diffusion
Img2CADSeq generates standard CAD sequences from images via a multi-stage pipeline with three-level hierarchical codebook encoding, importance-guided compression, and contrastive point-cloud conditioning of a VQ-Diffu...
-
AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects
AssemblyBench dataset and AssemblyDyno transformer model enable physics-aware prediction of assembly sequences and trajectories for complex industrial objects from multimodal instructions and 3D shapes.
-
CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation
CADBench is a new multimodal benchmark for CAD program generation that combines 18k samples from DeepCAD, Fusion 360, ABC, MCB, and Objaverse across clean/noisy meshes and various renders, used to test 11 models and r...
-
ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation
ArtiCAD presents the first training-free multi-agent framework that generates articulated, editable CAD assemblies from text or images by predicting assembly relationships early and using validation with rollback.
-
CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Reward
CAD-Coder generates valid CadQuery scripts from text via supervised fine-tuning followed by reinforcement learning with geometric Chamfer Distance rewards and chain-of-thought planning.
-
ASSEMCAD: Production-Ready CAD Assembly Generation from Natural Language
AssemCAD generates production-oriented CAD assemblies from language via axiom-grounded specs, port-mate libraries, on-demand factories, and geometry-aware verification, beating code-only baselines on AssemBench.
-
SOV-CAD: Stepwise Orthographic Views Guided CAD Modeling Sequence Reconstruction
SOV-CAD recovers CAD modeling sequences from orthographic images via Decision-Transformer offline RL conditioned on stepwise three-views plus sketch canvas and IoU-based rewards, beating holistic baselines with better...
-
MV-GEL: Language-Driven Multi-View Geometric Entity Localization on Meshes
MV-GEL localizes fine-grained geometric entities on 3D meshes from natural language by ranking informative views with GELviews, applying VLM segmentation, and lifting masks via geometry-aware ray casting, reporting up...
-
MV-GEL: Language-Driven Multi-View Geometric Entity Localization on Meshes
MV-GEL uses a learned view selector and a fine-tuned vision-language segmentation model to localize text-described faces and edges on 3D meshes.
-
Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Design
A hybrid agentic architecture integrates knowledge-based physical verification tools into LLM-driven CAD design loops, producing more complex and functionally valid designs than prior agentic baselines.
-
CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation
CADBench is a multimodal benchmark for CAD program generation that shows specialized mesh-to-CAD models outperform general vision-language models but degrade with complexity and modality shifts.
-
CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization
CADFit recovers complex editable CAD construction sequences from meshes via IoU-driven hybrid optimization over structured programs, outperforming prior methods on volumetric IoU, Chamfer Distance, and invalid ratio.
-
CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization
CADFit recovers complex editable CAD construction sequences from meshes via IoU-driven hybrid optimization and outperforms prior mesh-to-CAD methods on volumetric IoU, Chamfer Distance, and invalid program ratio.
-
Agent-Aided Design for Dynamic CAD Models
AADvark extends agent-aided CAD design to dynamic 3D assemblies with movable parts by integrating constraint solvers and visual feedback to create a verification signal for the agent.
-
Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection
Pointer-CAD unifies B-Rep geometry with command sequences via pointer-based entity selection, allowing LLMs to perform complex CAD edits while cutting topological errors from quantization.
-
BrepCoder: A Unified Multimodal Large Language Model for Multi-task B-rep Reasoning
BrepCoder trains one multimodal LLM to read B-rep CAD geometry and output CAD code, handling reverse engineering, completion, error correction, and CAD-QA.
-
STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models
STEP-LLM fine-tunes LLMs to emit complete STEP CAD files from natural-language captions, reporting lower median Chamfer distance than Text2CAD.
-
BrepLLM: Enabling Large Language Models to Understand Boundary Representations
BrepLLM feeds boundary-representation CAD graphs directly into an LLM and reports state-of-the-art CAD captioning and generative classification over point-cloud 3D-LLM baselines.
-
CADDesigner: Conceptual CAD Model Generation with a General-Purpose Agent
CADDesigner presents an LLM agent with ECIP paradigm and visual feedback loop that generates conceptual CAD models from text and sketches while storing results in a knowledge base.
-
Pointer-CAD v2: Plan-Then-Construct CAD Generation with Dimension-Aware Parametric Precision
Pointer-CAD v2 decouples planning from construction in LLM-based CAD generation by using a pointer mechanism to reference continuous parameters from a design plan, paired with new hierarchical accuracy metrics.
-
Memory-Augmented Reinforcement Learning Agent for CAD Generation
Memory-augmented RL agent with case and skill libraries plus dynamic retrieval improves success rate and geometric consistency for complex CAD model generation.
-
CADDesigner: Conceptual CAD Model Generation with a General-Purpose Agent
CADDesigner is an LLM agent that generates conceptual CAD models from text and sketches via requirement analysis, the ECIP paradigm, and iterative visual feedback, outperforming baselines in experiments.
-
Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation
Hunyuan3D 2.0 scales flow-based diffusion transformers and texture synthesis models to generate high-resolution textured 3D assets that outperform prior state-of-the-art in geometry, alignment, and texture quality.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.