pith. sign in

arxiv: 2402.05904 · v1 · pith:JY6UPV2Xnew · submitted 2024-02-08 · 💻 cs.CL · cs.CY· cs.HC· cs.SI

FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs

classification 💻 cs.CL cs.CYcs.HCcs.SI
keywords llmsclaimfact-gptmatchingclaimsfact-checkingmodelsresearch
0
0 comments X
read the original abstract

Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides an automated solution for efficient claim matching, demonstrates the potential of LLMs in supporting fact-checkers, and offers valuable resources for further research in the field.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. How Human Feedback Shapes AI-generated Community Notes

    cs.CY 2026-06 unverdicted novelty 7.0

    Human feedback improves AI-generated Community Notes but participation limits their adoption rate, with collaborative notes serving a complementary role to human and AI-only notes.