pith. sign in

arxiv: 2403.15161 · v1 · pith:YNNB52DPnew · submitted 2024-03-22 · 💻 cs.CV

FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videos

classification 💻 cs.CV
keywords alignmentfastcadreal-timeaccuracyembeddingslearningmethodmethods
0
0 comments X
read the original abstract

Digitising the 3D world into a clean, CAD model-based representation has important applications for augmented reality and robotics. Current state-of-the-art methods are computationally intensive as they individually encode each detected object and optimise CAD alignments in a second stage. In this work, we propose FastCAD, a real-time method that simultaneously retrieves and aligns CAD models for all objects in a given scene. In contrast to previous works, we directly predict alignment parameters and shape embeddings. We achieve high-quality shape retrievals by learning CAD embeddings in a contrastive learning framework and distilling those into FastCAD. Our single-stage method accelerates the inference time by a factor of 50 compared to other methods operating on RGB-D scans while outperforming them on the challenging Scan2CAD alignment benchmark. Further, our approach collaborates seamlessly with online 3D reconstruction techniques. This enables the real-time generation of precise CAD model-based reconstructions from videos at 10 FPS. Doing so, we significantly improve the Scan2CAD alignment accuracy in the video setting from 43.0% to 48.2% and the reconstruction accuracy from 22.9% to 29.6%.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. CAOA -- Completion-Assisted Object-CAD Alignment

    cs.CV 2026-06 unverdicted novelty 6.0

    CAOA uses a completion module and symmetry loss to achieve 17% better CAD alignment accuracy on Scan2CAD, plus releases the S2C-Completion dataset of 8500 pairs.