FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs
read the original abstract
Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides an automated solution for efficient claim matching, demonstrates the potential of LLMs in supporting fact-checkers, and offers valuable resources for further research in the field.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
How Human Feedback Shapes AI-generated Community Notes
Human feedback improves AI-generated Community Notes but participation limits their adoption rate, with collaborative notes serving a complementary role to human and AI-only notes.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.