REVIEW 4 cited by
ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are interdependent. Current models struggle with these intricate directives, and existing benchmarks inadequately evaluate such capabilities. Specifically, they often overlook multi-instruction and chain-instruction complexities, and common consistency metrics are flawed. To address this, we introduce ComplexBench-Edit, a novel benchmark designed to systematically assess model performance on complex, multi-instruction, and chain-dependent image editing tasks. ComplexBench-Edit also features a new vision consistency evaluation method that accurately assesses non-modified regions by excluding edited areas. Furthermore, we propose a simple yet powerful Chain-of-Thought (CoT)-based approach that significantly enhances the ability of existing models to follow complex instructions. Our extensive experiments demonstrate ComplexBench-Edit's efficacy in differentiating model capabilities and highlight the superior performance of our CoT-based method in handling complex edits. The data and code are released at https://github.com/llllly26/ComplexBench-Edit.
Forward citations
Cited by 4 Pith papers
-
LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generation
An LVLM-driven iterative text-to-image framework whose claimed performance scores are explicitly labeled fictitious, so no empirical result is established.
-
CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs
CIMR, an iterative reasoning wrapper around LLaVA-1.5-7B, reports 91.5% task completion on a newly constructed but unreleased synthetic MAP dataset, above GPT-4V at 89.2%.
-
Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing States
CMLReID uses dynamic text prompts and dual-path prototypes to improve lifelong person re-identification in hybrid clothing states, reporting gains of about 5 mAP over four baselines.
-
Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidance
The proposed CAMVR framework is not supported by verifiable evidence, and the manuscript itself labels its experimental results as fabricated.
Discussion (0). Sign in to comment.