Pith. sign in

REVIEW 1 cited by

Claim Detection in Biomedical Twitter Posts

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2104.11639 v2 pith:UPFYC4EL submitted 2021-04-23 cs.CL cs.SI

classification cs.CLcs.SI
keywords biomedicaltweetsclaimclaimscorpusdetectionbaselinechallenging
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Social media contains unfiltered and unique information, which is potentially of great value, but, in the case of misinformation, can also do great harm. With regards to biomedical topics, false information can be particularly dangerous. Methods of automatic fact-checking and fake news detection address this problem, but have not been applied to the biomedical domain in social media yet. We aim to fill this research gap and annotate a corpus of 1200 tweets for implicit and explicit biomedical claims (the latter also with span annotations for the claim phrase). With this corpus, which we sample to be related to COVID-19, measles, cystic fibrosis, and depression, we develop baseline models which detect tweets that contain a claim automatically. Our analyses reveal that biomedical tweets are densely populated with claims (45 % in a corpus sampled to contain 1200 tweets focused on the domains mentioned above). Baseline classification experiments with embedding-based classifiers and BERT-based transfer learning demonstrate that the detection is challenging, however, shows acceptable performance for the identification of explicit expressions of claims. Implicit claim tweets are more challenging to detect.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Evaluating the Performance of Large Language Models in Scientific Claim Detection and Classification

    cs.CL 2024-12 reject novelty 4.0 of 10

    On 1,847 COVID-19 tweets, GPT-4 scored highest at detecting and classifying scientific claims (F1 0.65-0.76), but the evaluation lacks error bars, baselines, and open artifacts.

Pith tools