RELIANCE is a new expert-annotated dataset of TikTok reproductive health content paired with LLM fact-checking evaluations showing 60% accuracy in sampled videos and a 15% gap between claim and full-content assessment.
Automatic Detection of Fake News
2 Pith papers cite this work. Polarity classification is still indexing.
abstract
The proliferation of misleading information in everyday access media outlets such as social media feeds, news blogs, and online newspapers have made it challenging to identify trustworthy news sources, thus increasing the need for computational tools able to provide insights into the reliability of online content. In this paper, we focus on the automatic identification of fake content in online news. Our contribution is twofold. First, we introduce two novel datasets for the task of fake news detection, covering seven different news domains. We describe the collection, annotation, and validation process in detail and present several exploratory analysis on the identification of linguistic differences in fake and legitimate news content. Second, we conduct a set of learning experiments to build accurate fake news detectors. In addition, we provide comparative analyses of the automatic and manual identification of fake news.
representative citing papers
By steering activations along directions learned from base-vs-fine-tuned disagreements, REFLEX reports 64.99 macro-F1 on RAW-FC fact-checking with only ~465 self-refined contrastive samples and no retrieval.
citing papers explorer
-
RELIANCE: Curating and Evaluating Reproductive Health Information on Social Media
RELIANCE is a new expert-annotated dataset of TikTok reproductive health content paired with LLM fact-checking evaluations showing 60% accuracy in sampled videos and a 15% gap between claim and full-content assessment.
-
REFLEX: Self-Refining Explainable Fact-Checking via Verdict-Anchored Style Control
By steering activations along directions learned from base-vs-fine-tuned disagreements, REFLEX reports 64.99 macro-F1 on RAW-FC fact-checking with only ~465 self-refined contrastive samples and no retrieval.