How Spammers and Scammers Leverage AI-Generated Images on Facebook for Audience Growth

Josh A. Goldstein; Renee DiResta

How Spammers and Scammers Leverage AI-Generated Images on Facebook for Audience Growth

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.12838 v1 pith:NWMYNRZG submitted 2024-03-19 cs.CY

Renee DiResta , Josh A. Goldstein This is my paper · ORCID

classification cs.CY

keywords imagesai-generatedfacebookdiscoursescammersspammersalreadyaround

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

Much of the research and discourse on risks from artificial intelligence (AI) image generators, such as DALL-E and Midjourney, has centered around whether they could be used to inject false information into political discourse. We show that spammers and scammers - seemingly motivated by profit or clout, not ideology - are already using AI-generated images to gain significant traction on Facebook. At times, the Facebook Feed is recommending unlabeled AI-generated images to users who neither follow the Pages posting the images nor realize that the images are AI-generated, highlighting the need for improved transparency and provenance standards as AI models proliferate.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

AI Humor Generation: Cognitive, Social and Creative Skills for Effective Humor
cs.HC 2025-02 conditional novelty 6.0 of 10

A fine-tuned LLM pipeline that extracts image details, generates relatable narratives, and ranks captions with a Gen Z humor judge produces Instagram captions rated nearly as funny as top human captions by Gen Z raters.

Pith tools