REVIEW 5 cited by
DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Data is the cornerstone of deep learning. This paper reveals that the recently developed Diffusion Model is a scalable data engine for object detection. Existing methods for scaling up detection-oriented data often require manual collection or generative models to obtain target images, followed by data augmentation and labeling to produce training pairs, which are costly, complex, or lacking diversity. To address these issues, we presentDiffusionEngine (DE), a data scaling-up engine that provides high-quality detection-oriented training pairs in a single stage. DE consists of a pre-trained diffusion model and an effective Detection-Adapter, contributing to generating scalable, diverse and generalizable detection data in a plug-and-play manner. Detection-Adapter is learned to align the implicit semantic and location knowledge in off-the-shelf diffusion models with detection-aware signals to make better bounding-box predictions. Additionally, we contribute two datasets, i.e., COCO-DE and VOC-DE, to scale up existing detection benchmarks for facilitating follow-up research. Extensive experiments demonstrate that data scaling-up via DE can achieve significant improvements in diverse scenarios, such as various detection algorithms, self-supervised pre-training, data-sparse, label-scarce, cross-domain, and semi-supervised learning. For example, when using DE with a DINO-based adapter to scale up data, mAP is improved by 3.1% on COCO, 7.6% on VOC, and 11.5% on Clipart.
Forward citations
Cited by 5 Pith papers
-
Adapting Vehicle Detectors for Aerial Imagery to Unseen Domains with Weak Supervision
A multi-stage diffusion-based framework that generates labeled synthetic aerial images from weak image-level labels improves cross-domain vehicle detection AP50 over prior adaptation methods.
-
Scene-Aware Location Modeling for Data Augmentation in Automotive Object Detection
A depth- and drivable-space-conditioned probabilistic location model places inpainted objects realistically, giving state-of-the-art generative augmentation for automotive detection and segmentation.
-
Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation
DAKTer jointly generates SAR oil spill images and soft labels with a diffusion model, using an SNR balancing factor and cross-entropy training, and distills these soft labels into segmentation models to improve perfor...
-
Exploring Structured Semantic Priors Underlying Diffusion Score for Test-time Adaptation
DUSA adapts classifiers and segmenters at test time by matching their predictions to conditional noise estimates from a pre-trained diffusion model, using a single timestep and active class selection.
-
Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding
POBF paints new backgrounds around preserved objects to synthesize visual-grounding training data and filters those samples with teacher-model scores, improving accuracy by 5.83% over real-only training.
Discussion (0). Continue with ORCID to comment.