REVIEW 6 cited by
GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The extraordinary ability of generative models emerges as a new trend in image editing and generating realistic images, posing a serious threat to the trustworthiness of multimedia data and driving the research of image manipulation detection and location (IMDL). However, the lack of a large-scale data foundation makes the IMDL task unattainable. In this paper, we build a local manipulation data generation pipeline that integrates the powerful capabilities of SAM, LLM, and generative models. Upon this basis, we propose the GIM dataset, which has the following advantages: 1) Large scale, GIM includes over one million pairs of AI-manipulated images and real images. 2) Rich image content, GIM encompasses a broad range of image classes. 3) Diverse generative manipulation, the images are manipulated images with state-of-the-art generators and various manipulation tasks. The aforementioned advantages allow for a more comprehensive evaluation of IMDL methods, extending their applicability to diverse images. We introduce the GIM benchmark with two settings to evaluate existing IMDL methods. In addition, we propose a novel IMDL framework, termed GIMFormer, which consists of a ShadowTracer, Frequency-Spatial block (FSB), and a Multi-Window Anomalous Modeling (MWAM) module. Extensive experiments on the GIM demonstrate that GIMFormer surpasses the previous state-of-the-art approach on two different benchmarks.
Forward citations
Cited by 6 Pith papers
-
AI-generated Images Challenge Visual Trust in High-risk Scenarios
On SafeIMG, a new safety-focused benchmark of 1,131 GPT Image 2 images, the best VLM detects 49.5% of generated images and the best specialized detector 33.1%, versus 81.7% for humans.
-
ComRoPE: Scalable and Robust Rotary Position Embedding Parameterized by Trainable Commuting Angle Matrices
Trainable commuting angle matrices generalize Rotary Position Embedding and improve accuracy and resolution robustness on vision Transformers.
-
$K^2$VAE: A Koopman-Kalman Enhanced Variational AutoEncoder for Probabilistic Time Series Forecasting
Combining a learned Koopman linearization with a learned Kalman filter inside a VAE produces a probabilistic forecaster that beats existing methods on most tested short- and long-horizon datasets.
-
IMDPrompter: Adapting SAM to Image Manipulation Detection by Cross-View Automated Prompt Learning
IMDPrompter learns cross-view prompts for SAM from RGB, SRM, Bayer, and Noiseprint features, and reports state-of-the-art image manipulation detection and localization on five benchmarks.
-
Weakly Supervised Temporal Action Localization via Dual-Prior Collaborative Learning Guided by Multimodal Large Language Models
A training-time framework that uses MLLM-generated action descriptions to improve weakly supervised temporal action localization, with small mAP gains on THUMOS14 and ActivityNet-v1.2.
-
Rethinking Pseudo-Label Guided Learning for Weakly Supervised Temporal Action Localization from the Perspective of Noise Correction
NoCo corrects noisy pseudo-labels for weakly supervised temporal action localization, reporting state-of-the-art accuracy on THUMOS14 and ActivityNet v1.2.
Discussion (0). Continue with ORCID to comment.