REVIEW 10 cited by
GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Diffusion models have attracted significant attention due to the remarkable ability to create content and generate data for tasks like image classification. However, the usage of diffusion models to generate the high-quality object detection data remains an underexplored area, where not only image-level perceptual quality but also geometric conditions such as bounding boxes and camera views are essential. Previous studies have utilized either copy-paste synthesis or layout-to-image (L2I) generation with specifically designed modules to encode the semantic layouts. In this paper, we propose the GeoDiffusion, a simple framework that can flexibly translate various geometric conditions into text prompts and empower pre-trained text-to-image (T2I) diffusion models for high-quality detection data generation. Unlike previous L2I methods, our GeoDiffusion is able to encode not only the bounding boxes but also extra geometric conditions such as camera views in self-driving scenes. Extensive experiments demonstrate GeoDiffusion outperforms previous L2I methods while maintaining 4x training time faster. To the best of our knowledge, this is the first work to adopt diffusion models for layout-to-image generation with geometric conditions and demonstrate that L2I-generated images can be beneficial for improving the performance of object detectors.
Forward citations
Cited by 10 Pith papers
-
OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation
A joint diffusion framework trains a Stable Diffusion generator and a semantic occupancy perception model together, so each task improves the other, producing text-conditional RGB-occupancy pairs.
-
To Blend In, First Decouple: Rethinking Camouflage Image Generation via Context-Decoupled Representations
CamoDreamer generates camouflage images by decoupling foreground and background control in a diffusion model, reporting a 15.5-point FID gain over prior state of the art on LAKE-RED.
-
FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation
A frequency-guided layout-to-image generation framework, FICGen, improves fidelity, layout alignment, and detector trainability on degraded scenes across five benchmarks.
-
Detail++: Training-Free Detail Enhancer for T2I Diffusion Models
Detail++ uses progressive multi-branch prompt injection and test-time attention optimization to improve attribute binding in text-to-image generation.
-
Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation
DAKTer jointly generates SAR oil spill images and soft labels with a diffusion model, using an SNR balancing factor and cross-entropy training, and distills these soft labels into segmentation models to improve perfor...
-
Scaling Up Occupancy-centric Driving Scene Generation: Dataset and Method
UniScenev2 scales occupancy-centric driving-scene generation to NuPlan scale, releasing a 3.6M-frame semantic-occupancy dataset and jointly generating occupancy, video, and LiDAR that beats published baselines on its ...
-
FLORA: Efficient Synthetic Data Generation for Object Detection in Low-Data Regimes via finetuning Flux LoRA
A LoRA fine-tuned Flux inpainting pipeline generates synthetic object detection images that outperform ODGEN's 10x larger synthetic set in downstream mAP.
-
Edge-case Synthesis for Fisheye Object Detection: A Data-centric Perspective
Edge-case synthesis with a fine-tuned text-to-image model improves fisheye object detection, but the gain is not isolated from simply adding more data.
-
LocRef-Diffusion:Tuning-Free Layout and Appearance-Guided Generation
LocRef-Diffusion inserts two lightweight cross-attention modules into Stable Diffusion to control both layout and appearance of multiple instances without fine-tuning per object.
-
ECCV 2024 W-CODA: 1st Workshop on Multimodal Perception and Comprehension of Corner Cases in Autonomous Driving
A workshop report documenting the ECCV 2024 W-CODA event, its accepted papers, speakers, and the dual-track corner case understanding and generation challenge.
Discussion (0). Continue with ORCID to comment.