SciVer is the first benchmark for multimodal scientific claim verification over full paper context, and current foundation models score about 16 points below expert humans.
Fin-Fact: A Benchmark Dataset for Multimodal Financial Fact Checking and Explanation Generation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Fact-checking in financial domain is under explored, and there is a shortage of quality dataset in this domain. In this paper, we propose Fin-Fact, a benchmark dataset for multimodal fact-checking within the financial domain. Notably, it includes professional fact-checker annotations and justifications, providing expertise and credibility. With its multimodal nature encompassing both textual and visual content, Fin-Fact provides complementary information sources to enhance factuality analysis. Its primary objective is combating misinformation in finance, fostering transparency, and building trust in financial reporting and news dissemination. By offering insightful explanations, Fin-Fact empowers users, including domain experts and end-users, to understand the reasoning behind fact-checking decisions, validating claim credibility, and fostering trust in the fact-checking process. The Fin-Fact dataset, along with our experimental codes is available at https://github.com/IIT-DM/Fin-Fact/.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verification
SciVer is the first benchmark for multimodal scientific claim verification over full paper context, and current foundation models score about 16 points below expert humans.