REVIEW 6 cited by
MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We introduce the Multi-Instance Generation (MIG) task, which focuses on generating multiple instances within a single image, each accurately placed at predefined positions with attributes such as category, color, and shape, strictly following user specifications. MIG faces three main challenges: avoiding attribute leakage between instances, supporting diverse instance descriptions, and maintaining consistency in iterative generation. To address attribute leakage, we propose the Multi-Instance Generation Controller (MIGC). MIGC generates multiple instances through a divide-and-conquer strategy, breaking down multi-instance shading into single-instance tasks with singular attributes, later integrated. To provide more types of instance descriptions, we developed MIGC++. MIGC++ allows attribute control through text \& images and position control through boxes \& masks. Lastly, we introduced the Consistent-MIG algorithm to enhance the iterative MIG ability of MIGC and MIGC++. This algorithm ensures consistency in unmodified regions during the addition, deletion, or modification of instances, and preserves the identity of instances when their attributes are changed. We introduce the COCO-MIG and Multimodal-MIG benchmarks to evaluate these methods. Extensive experiments on these benchmarks, along with the COCO-Position benchmark and DrawBench, demonstrate that our methods substantially outperform existing techniques, maintaining precise control over aspects including position, attribute, and quantity. Project page: https://github.com/limuloo/MIGC.
Forward citations
Cited by 6 Pith papers
-
LAION-SG: An Enhanced Large-Scale Dataset for Training Complex Image-Text Models with Structural Annotations
A 540,005-image dataset with GPT-4o-produced scene graph annotations improves compositional text-to-image generation when used to fine-tune SDXL-based models.
-
CC-Diff: Enhancing Contextual Coherence in Remote Sensing Image Synthesis
CC-Diff couples foreground and background generation in diffusion-based layout-to-image synthesis, improving FID, CLIPScore, YOLOScore, and detection trainability on DIOR-RSVG, DOTA, and COCO.
-
Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy
IP-CIR creates imagined proxy images from a query image and caption via LLM-based layout and conditional generation, then blends proxy, query, and text features to improve zero-shot composed image retrieval.
-
Inversion-DPO: Precise and Efficient Post-Training for Diffusion Models
Inversion-DPO uses DDIM inversion to convert winning and losing images into noise trajectories, yielding a simpler DPO loss for diffusion model alignment that trains faster and improves text-to-image and compositional...
-
AnySynth: Harnessing the Power of Image Synthetic Data Generation for Generalized Vision-Language Tasks
AnySynth is a single synthetic-data pipeline that produces layouts, images, and annotations for multiple vision tasks, and its data improves benchmark scores by small but consistent margins.
-
FBI: Learning Dexterous In-hand Manipulation with Dynamic Visuotactile Shortcut Policy
The abstract claims a new visuotactile robot manipulation policy (FBI) that outperforms baselines, but the manuscript body is an unrelated paper on text-to-image synthesis, so the claimed result is absent.
Discussion (0). Continue with ORCID to comment.