The reviewed record of science sign in
Pith

arxiv: 2310.02426 · v1 · pith:VFFNHL2V · submitted 2023-10-03 · cs.CV

EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:VFFNHL2Vrecord.jsonopen to challenge →

classification cs.CV
keywords methodseditingeditvalimageedittypesevaluationtext-guided
0
0 comments X
read the original abstract

A plethora of text-guided image editing methods have recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models such as Imagen and Stable Diffusion. A standardized evaluation protocol, however, does not exist to compare methods across different types of fine-grained edits. To address this gap, we introduce EditVal, a standardized benchmark for quantitatively evaluating text-guided image editing methods. EditVal consists of a curated dataset of images, a set of editable attributes for each image drawn from 13 possible edit types, and an automated evaluation pipeline that uses pre-trained vision-language models to assess the fidelity of generated images for each edit type. We use EditVal to benchmark 8 cutting-edge diffusion-based editing methods including SINE, Imagic and Instruct-Pix2Pix. We complement this with a large-scale human study where we show that EditVall's automated evaluation pipeline is strongly correlated with human-preferences for the edit types we considered. From both the human study and automated evaluation, we find that: (i) Instruct-Pix2Pix, Null-Text and SINE are the top-performing methods averaged across different edit types, however {\it only} Instruct-Pix2Pix and Null-Text are able to preserve original image properties; (ii) Most of the editing methods fail at edits involving spatial operations (e.g., changing the position of an object). (iii) There is no `winner' method which ranks the best individually across a range of different edit types. We hope that our benchmark can pave the way to developing more reliable text-guided image editing tools in the future. We will publicly release EditVal, and all associated code and human-study templates to support these research directions in https://deep-ml-research.github.io/editval/.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing

    eess.AS 2026-06 unverdicted novelty 7.0

    SpeechEditBench provides seven atomic editing tasks, compositional multi-operation instructions, and an anchor-based protocol yielding target success, preservation success, and joint success metrics; evaluations show ...

  2. What Semantics Survive the Connector? Diagnosing VLM-to-DiT Alignment in Video Editing

    cs.CV 2026-05 unverdicted novelty 7.0

    VLM-to-DiT alignment in video editing models acts as a semantic bottleneck that degrades fine-grained structural semantics, demonstrated via a new diagnostic dataset and protocol on relation-based edits.

  3. UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs

    cs.CV 2026-04 unverdicted novelty 7.0

    UniEditBench unifies image and video editing evaluation with a nine-plus-eight operation taxonomy and cost-effective 4B/8B distilled MLLM evaluators that align with human judgments.

  4. What Semantics Survive the Connector? Diagnosing VLM-to-DiT Alignment in Video Editing

    cs.CV 2026-05 unverdicted novelty 6.0

    Introduces TRACE-Edit dataset and evaluation protocol demonstrating semantic degradation of structural variables during VLM-to-DiT alignment in flow-matching video editors.

  5. Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions

    cs.CV 2026-04 unverdicted novelty 6.0

    An MLLM agent reformulates image editing tasks into executable operation sequences to improve reliability on challenging cases across existing generative backbones.

  6. Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment

    cs.CV 2026-04 unverdicted novelty 6.0

    DS-IEQA jointly learns evaluation criteria via feedback-driven prompt optimization and continuous score modeling via token-decoupled distance regression, ranking 4th in the 2026 NTIRE X-AIGC Quality Assessment Track 2...

  7. VDE Bench: Evaluating The Capability of Image Editing Models to Modify Visual Documents

    cs.CV 2026-01 unverdicted novelty 6.0

    VDE Bench is a new human-annotated dataset and OCR-based evaluation framework for measuring image editing model performance on bilingual dense visual documents.

  8. ImgEdit: A Unified Image Editing Dataset and Benchmark

    cs.CV 2025-05 conditional novelty 6.0

    ImgEdit supplies 1.2 million curated edit pairs and a three-part benchmark that let a VLM-based model outperform prior open-source editors on adherence, quality, and detail preservation.

  9. PaintBench: Deterministic Evaluation of Precise Visual Editing

    cs.GR 2026-05 unverdicted novelty 5.0

    PaintBench provides a scalable deterministic benchmark for precise visual editing operations, revealing that even the best of 11 models achieves only 17.1% mIoU and that scores correlate strongly with applied data vis...