Pith. sign in

REVIEW 16 cited by

DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2307.01426 v2 pith:Z7O77JUS submitted 2023-07-04 cs.CV

DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection

Zhiyuan Yan , Yong Zhang , Xinhang Yuan , Siwei Lyu , Baoyuan Wu This is my paper
classification cs.CV
keywords detectiondeepfakebenchmarkcomprehensivedatadeepfakebenchevaluationevaluations
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

A critical yet frequently overlooked challenge in the field of deepfake detection is the lack of a standardized, unified, comprehensive benchmark. This issue leads to unfair performance comparisons and potentially misleading results. Specifically, there is a lack of uniformity in data processing pipelines, resulting in inconsistent data inputs for detection models. Additionally, there are noticeable differences in experimental settings, and evaluation strategies and metrics lack standardization. To fill this gap, we present the first comprehensive benchmark for deepfake detection, called DeepfakeBench, which offers three key contributions: 1) a unified data management system to ensure consistent input across all detectors, 2) an integrated framework for state-of-the-art methods implementation, and 3) standardized evaluation metrics and protocols to promote transparency and reproducibility. Featuring an extensible, modular-based codebase, DeepfakeBench contains 15 state-of-the-art detection methods, 9 deepfake datasets, a series of deepfake detection evaluation protocols and analysis tools, as well as comprehensive evaluations. Moreover, we provide new insights based on extensive analysis of these evaluations from various perspectives (e.g., data augmentations, backbones). We hope that our efforts could facilitate future research and foster innovation in this increasingly critical domain. All codes, evaluations, and analyses of our benchmark are publicly available at https://github.com/SCLBD/DeepfakeBench.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 16 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Toward Calibrated, Fair, and accurate Deepfake Detection

    cs.LG 2026-06 unverdicted novelty 7.0

    Face-Feature Tuning is a label-free logit remapping method that reduces FPR/TPR gaps across groups in deepfake detection while preserving overall accuracy.

  2. SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation

    cs.CV 2026-06 unverdicted novelty 7.0

    SynCred-Bench shows that 15 MLLMs reach only 10.5% TPR, open-source detectors under 5%, commercial APIs 57.6%, and humans 63% TPR at 5% FPR when identifying AI-generated images with synthetic credibility.

  3. The Regularizing Power of Language-Training Deepfake Detectors

    cs.CV 2026-05 unverdicted novelty 7.0

    A dual-encoder deepfake detector pairs a frozen specialist with a LoRA-tuned MLLM, trained first via binary alignment then via RL to reward explain-then-classify behavior, yielding improved cross-dataset performance a...

  4. PluRule: A Benchmark for Moderating Pluralistic Communities on Social Media

    cs.CL 2026-05 unverdicted novelty 7.0

    PluRule is a new multimodal multilingual benchmark showing that state-of-the-art vision-language models perform only marginally better than a trivial baseline at detecting specific rule violations in pluralistic onlin...

  5. Abductive Corroboration of Probabilistic AI Models for Forensic Synthetic Media Detection

    cs.CR 2026-07 conditional novelty 6.0

    Multi-detector corroboration reduces FP/TP from ~0.22 to 0.02 (two models) or 0 (three models) while first measuring OpenAI SynthID production rollout and detector complementarity.

  6. What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations

    cs.CV 2026-06 unverdicted novelty 6.0

    Linear probes on frozen self-supervised representations closely approach bespoke deepfake detector performance on benchmarks, indicating benchmarks largely measure general modality understanding.

  7. Open Set Face Forgery Detection via Dual-Level Evidence Collection

    cs.CV 2025-12 unverdicted novelty 6.0

    DLED reformulates open-set face forgery detection as an uncertainty estimation task and uses dual-level spatial-frequency evidence collection to identify novel fake categories, claiming 20% average gains over baselines.

  8. When Generative Replay Meets Evolving Deepfakes: Dual Confusion-Aware Regularization for Incremental Face Forgery Detection

    cs.CV 2025-11 conditional novelty 6.0

    Adaptively weighting direct supervision versus a relative-separation loss makes generative replay work for incremental deepfake detection.

  9. InfoDense: Density-Aware Regional Decisive Replay for Memory-Efficient Incremental Face Forgery Detection

    cs.CV 2026-07 conditional novelty 5.0

    InfoDense replays only density-ranked, forgery-decisive face fragments rather than full images, cutting memory use and improving incremental deepfake detection.

  10. Suppressing Forgery-Specific Shortcuts for Generalizable Deepfake Detection

    cs.CV 2026-06 unverdicted novelty 5.0

    S^3 extracts dominant shortcut directions from a linear forgery-method classifier using SVD and attenuates them in feature space to improve cross-method generalization in deepfake detection.

  11. Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection

    cs.CV 2026-05 unverdicted novelty 5.0

    Lightweight fusion of WDF with SPSL or LBP cues into Xception improves AUC by 3.8-4.4% on FaceForensics++ and DFDC-Preview with negligible parameter overhead compared to larger frequency-based detectors.

  12. Generalizable Deepfake Detection Based on Forgery-aware Layer Masking and Multi-artifact Subspace Decomposition

    cs.CV 2026-01 unverdicted novelty 5.0

    FMSD improves cross-dataset generalization in deepfake detection by using gradient-based layer masking to select forgery-sensitive weights and SVD to split them into preserved semantic and multiple learnable artifact ...

  13. A Spatial-Frequency Aware Multi-Scale Fusion Network for Real-Time Deepfake Detection

    cs.CV 2025-08 conditional novelty 5.0

    SFMFNet uses wavelet-frequency gating, token-selective cross-attention, and blur pooling to reach 0.8682 average cross-dataset AUC with only 1.27 GFLOPs and 6.64M parameters.

  14. M3D-Net: Multi-Modal 3D Facial Feature Reconstruction Network for Deepfake Detection

    cs.CV 2026-04 unverdicted novelty 4.0

    M3D-Net reconstructs 3D facial features from RGB images and fuses them with RGB features through attention-based modules to achieve claimed state-of-the-art deepfake detection.

  15. LLM Harms: A Taxonomy and Discussion

    cs.CY 2025-12 reject novelty 3.0

    Proposes a five-bucket taxonomy of LLM harms and calls for dynamic auditing, but the systematic review behind it is not reproducible and contains mismatched citations.

  16. LLM Harms: A Taxonomy and Discussion

    cs.CY 2025-12 unverdicted novelty 3.0

    This paper proposes a taxonomy of LLM harms in five categories and suggests mitigation strategies plus a dynamic auditing system for responsible development.