A 36-model cross-paradigm benchmark on a hard 100-image corpus shows commercial APIs lead on MCC, open-source detectors trail on average, and a subset of strong rankers are miscalibrated at their default threshold.
The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation.BMC Genomics, 21(1):6, 2020
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection
A 36-model cross-paradigm benchmark on a hard 100-image corpus shows commercial APIs lead on MCC, open-source detectors trail on average, and a subset of strong rankers are miscalibrated at their default threshold.