Pith. sign in

REVIEW 1 cited by

FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videos

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.15161 v1 pith:YNNB52DP submitted 2024-03-22 cs.CV

classification cs.CV
keywords alignmentfastcadreal-timeaccuracyembeddingslearningmethodmethods
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Digitising the 3D world into a clean, CAD model-based representation has important applications for augmented reality and robotics. Current state-of-the-art methods are computationally intensive as they individually encode each detected object and optimise CAD alignments in a second stage. In this work, we propose FastCAD, a real-time method that simultaneously retrieves and aligns CAD models for all objects in a given scene. In contrast to previous works, we directly predict alignment parameters and shape embeddings. We achieve high-quality shape retrievals by learning CAD embeddings in a contrastive learning framework and distilling those into FastCAD. Our single-stage method accelerates the inference time by a factor of 50 compared to other methods operating on RGB-D scans while outperforming them on the challenging Scan2CAD alignment benchmark. Further, our approach collaborates seamlessly with online 3D reconstruction techniques. This enables the real-time generation of precise CAD model-based reconstructions from videos at 10 FPS. Doing so, we significantly improve the Scan2CAD alignment accuracy in the video setting from 43.0% to 48.2% and the reconstruction accuracy from 22.9% to 29.6%.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Diorama: Unleashing Zero-shot Single-view 3D Indoor Scene Modeling

    cs.CV 2024-11 conditional novelty 6.0 of 10

    Diorama produces a structured, CAD-based 3D scene model from one RGB image using pretrained foundation models and staged layout optimization, with no end-to-end training.

Pith tools