Pith. sign in

REVIEW 8 cited by

HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.04280 v2 pith:NC2USPTS submitted 2024-12-05 cs.CV cs.GR

classification cs.CVcs.GR
keywords editinghumaneditimagedatasetdatasetshumaninstructionsdata
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

We present HumanEdit, a high-quality, human-rewarded dataset specifically designed for instruction-guided image editing, enabling precise and diverse image manipulations through open-form language instructions. Previous large-scale editing datasets often incorporate minimal human feedback, leading to challenges in aligning datasets with human preferences. HumanEdit bridges this gap by employing human annotators to construct data pairs and administrators to provide feedback. With meticulously curation, HumanEdit comprises 5,751 images and requires more than 2,500 hours of human effort across four stages, ensuring both accuracy and reliability for a wide range of image editing tasks. The dataset includes six distinct types of editing instructions: Action, Add, Counting, Relation, Remove, and Replace, encompassing a broad spectrum of real-world scenarios. All images in the dataset are accompanied by masks, and for a subset of the data, we ensure that the instructions are sufficiently detailed to support mask-free editing. Furthermore, HumanEdit offers comprehensive diversity and high-resolution $1024 \times 1024$ content sourced from various domains, setting a new versatile benchmark for instructional image editing datasets. With the aim of advancing future research and establishing evaluation benchmarks in the field of image editing, we release HumanEdit at https://huggingface.co/datasets/BryanW/HumanEdit.

Discussion (0). Sign in to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. AInimation: Animating from Prompt to AI-Generated Responses

    cs.HC 2026-07 conditional novelty 6.0 of 10

    Animating prompt elements into their positions in an AI response improved users' ability to locate content, spot edits, and verify instructions in three lab experiments with 16 participants.

  2. DanceOPD: On-Policy Generative Field Distillation

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    Hard-routed, single low-noise on-policy velocity matching composes conflicting image-generation capabilities into one flow student better than joint training, merging, or dense OPD baselines.

  3. Trade-offs in Image Generation: How Do Different Dimensions Interact?

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A new benchmark and VLM-as-judge metric map trade-offs among ten image-generation dimensions across 14 models, with a visualization called DTM.

  4. ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies

    cs.CV 2025-06 conditional novelty 6.0 of 10

    Introduces a benchmark for chain-dependent image editing instructions plus a region-aware consistency metric, and shows a chain-of-thought prompt improves a Gemini-based editor.

  5. KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Models

    cs.CV 2025-05 conditional novelty 6.0 of 10

    A new benchmark, KRIS-Bench, evaluates image editing models on knowledge-grounded reasoning across factual, conceptual, and procedural tasks, and finds large performance gaps in current models.

  6. SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Models

    cs.CV 2025-10 conditional novelty 5.0 of 10

    A unified multimodal model can improve its own text-to-image generation by using its understanding module as a rewarder in a global-plus-local reward-weighted training loop.

  7. Track Any Anomalous Object: A Granular Video Anomaly Detection Pipeline

    cs.CV 2025-06 conditional novelty 5.0 of 10

    TAO pipelines object-centric anomaly scores into SAM2 prompts with a temporal consistency filter to obtain pixel-level anomaly segmentation and tracking.

  8. MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection

    cs.CV 2025-05 reject novelty 4.0 of 10

    MIND-Edit combines instruction rewriting with MLLM-derived visual embeddings to guide diffusion-based image editing, but the reported numbers only partly support the claim of state-of-the-art performance.

Pith tools