Pith. sign in

REVIEW 7 cited by

SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.04292 v3 pith:QGWBW35F submitted 2024-12-05 cs.CV cs.AI

Zhenglin Huang , Jinwei Hu , Xiangtai Li , Yiwei He , Xingyu Zhao , Bei Peng , Baoyuan Wu , Xiaowei Huang
show 1 more author
Guangliang Cheng
This is my paper
classification cs.CVcs.AI
keywords detectionimageimagesmediasocialdeepfakesidadataset
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The rapid advancement of generative models in creating highly realistic images poses substantial risks for misinformation dissemination. For instance, a synthetic image, when shared on social media, can mislead extensive audiences and erode trust in digital content, resulting in severe repercussions. Despite some progress, academia has not yet created a large and diversified deepfake detection dataset for social media, nor has it devised an effective solution to address this issue. In this paper, we introduce the Social media Image Detection dataSet (SID-Set), which offers three key advantages: (1) extensive volume, featuring 300K AI-generated/tampered and authentic images with comprehensive annotations, (2) broad diversity, encompassing fully synthetic and tampered images across various classes, and (3) elevated realism, with images that are predominantly indistinguishable from genuine ones through mere visual inspection. Furthermore, leveraging the exceptional capabilities of large multimodal models, we propose a new image deepfake detection, localization, and explanation framework, named SIDA (Social media Image Detection, localization, and explanation Assistant). SIDA not only discerns the authenticity of images, but also delineates tampered regions through mask prediction and provides textual explanations of the model's judgment criteria. Compared with state-of-the-art deepfake detection models on SID-Set and other benchmarks, extensive experiments demonstrate that SIDA achieves superior performance among diversified settings. The code, model, and dataset will be released.

Discussion (0). Sign in to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. DocShield: Towards AI Document Safety via Evidence-Grounded Agentic Reasoning

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    DocShield presents a new agentic reasoning framework using Cross-Cues-aware Chain of Thought to detect, localize, and explain text-centric forgeries in documents, with reported F1 gains of 41.4% over specialized metho...

  2. XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection

    cs.CV 2026-07 conditional novelty 6.5 of 10

    A million-scale deepfake benchmark with Edit-Check filtering, dual expert/lay explanations, and EntityScore/EvidenceScore shows fine-tuned detectors collapse under generator shift while surface fluency remains.

  3. Explaining AI-Image Detection: What the Heatmap Actually Shows

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Compression history, not synthesis, explains a near-perfect AI-image detector, and no tested heatmap causally explains its verdict.

  4. LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A dual-stream deepfake forensic model that adds DDIM reconstruction residuals to RGB features improves artifact localization and cross-generator detection in evaluations, with honest caveats about text faithfulness.

  5. Detecting Text Manipulation in Images using Vision Language Models

    cs.CV 2025-09 conditional novelty 6.0 of 10

    In zero-shot benchmarks, GPT-4o outperforms open-source VLMs and specialized manipulation detectors on text tampering detection in scene images and fantasy ID documents.

  6. AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Models

    cs.CV 2025-07 conditional novelty 6.0 of 10

    AIGI-Holmes combines visual expert pretraining, SFT on explanation data, and direct preference optimization to deliver human-verifiable explanations and top detection accuracy on unseen AI generators.

  7. DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models

    cs.CV 2025-06 conditional novelty 5.0 of 10

    DFBench adds a 540,000-image benchmark with 12 modern generators, partial edits, and distorted real images, and its three-model LMM ensemble, MoA-DF, reaches near-perfect recall on its own test split.

Pith tools