REVIEW 17 cited by
DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Personalized image generation holds great promise in assisting humans in everyday work and life due to its impressive ability to creatively generate personalized content across various contexts. However, current evaluations either are automated but misalign with humans or require human evaluations that are time-consuming and expensive. In this work, we present DreamBench++, a human-aligned benchmark that advanced multimodal GPT models automate. Specifically, we systematically design the prompts to let GPT be both human-aligned and self-aligned, empowered with task reinforcement. Further, we construct a comprehensive dataset comprising diverse images and prompts. By benchmarking 7 modern generative models, we demonstrate that DreamBench++ results in significantly more human-aligned evaluation, helping boost the community with innovative findings.
Forward citations
Cited by 17 Pith papers
-
MentalThink: Shaping Thoughts in Mental SVG World
MLLMs that generate and render SVG sketches as multi-turn intermediate reasoning steps reach 55.1% on VSIBench and 76.0% on MindCube, far above the Qwen2.5-VL-7B backbone.
-
Scone: Bridging Composition and Distinction in Subject-Driven Image Generation via Unified Understanding-Generation Modeling
Scone unifies subject understanding and generation in a two-stage trained model to improve both composition and distinction in multi-subject image generation, outperforming prior open-source models on new benchmarks.
-
HunyuanImage 3.0 Technical Report
HunyuanImage 3.0 is an open 80B-parameter multimodal autoregressive image generator that reportedly matches leading closed models on in-house benchmarks.
-
FreeCus: Free Lunch Subject-driven Customization in Diffusion Transformers
FreeCus is a training-free method that combines pivotal attention sharing, reversed noise shifting, and MLLM captions to personalize Flux.1 text-to-image generation from a single reference image.
-
Beyond Simple Edits: X-Planner for Complex Instruction-Based Image Editing
X-Planner, an MLLM-based planner, decomposes complex image-editing instructions into localized sub-edits with masks and boxes, improving editing quality on standard and new complex benchmarks.
-
Phantom-Data : Towards a General Subject-Consistent Video Generation Dataset
Phantom-Data provides around one million cross-context, identity-consistent reference-video pairs for subject-to-video generation, and training on it improves prompt following and visual quality.
-
OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generation
A benchmark and five-million-clip dataset for evaluating and training subject-to-video generation models, with three new metrics for subject consistency, naturalness, and text alignment.
-
MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Models
MMIG-Bench is a unified benchmark of 4,850 prompts and 1,750 reference images with a three-level evaluation suite, including the VQA-based Aspect Matching Score that correlates with human ratings.
-
OmniGenBench: A Benchmark for Omnipotent Multimodal Generation across 50+ Tasks
A 57-task benchmark for multimodal image generation that uses automated visual parsers and an LLM judge to show GPT-4o-Native leads current models.
-
I Think, Therefore I Diffuse: Enabling Multimodal In-Context Reasoning in Diffusion Models
ThinkDiff aligns vision-language model features to a T5 decoder via captioning, then injects those features into a T5-based diffusion decoder, achieving 46.3% on the CoBSAT benchmark without reasoning-specific training data.
-
DreamFit: Garment-Centric Human Generation via a Lightweight Anything-Dressing Encoder
DreamFit generates human images from a garment reference and text by encoding the reference through LoRA-activated layers of a frozen Stable Diffusion UNet and injecting features with adaptive attention.
-
HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluator
HEIE is an MLLM-based evaluator that predicts defect heatmaps, plausibility scores, and natural-language explanations for AI-generated images, along with a new explainability dataset.
-
MultiCompose: Multi-Concept Personalized Composition with Per-Subject Attribute Binding
MultiCompose combines embedding regularization, cross-attention suppression, and mask-guided denoising to compose independently personalized subjects into one image while keeping each subject's attributes exclusive.
-
Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model
A new large benchmark for AI-generated human-centric video quality with pairwise preferences, plus a Mixture-of-Experts MLLM that outperforms prior methods on rating, comparison, and Q&A.
-
Training Free Stylized Abstraction
A training-free framework coupling VLLM-based identity distillation with cross-domain rectified flow inversion generates identity-preserving stylized abstractions from a single reference image, evaluated by a new GPT-...
-
DiffSim: Taming Diffusion Models for Evaluating Visual Similarity
A diffusion U-Net's attention features, aligned with a bidirectional attention score, can rank visual similarity competitively with CLIP, DINO, and LPIPS.
-
Survey on AI-Generated Media Detection: From Non-MLLM to MLLM
A survey organizing AI-generated media detection into Non-MLLM and MLLM based methods, with task and benchmark taxonomies.
Discussion (0). Continue with ORCID to comment.