REVIEW 4 cited by
AI-AI Bias: large language models favor communications generated by large language models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Are large language models (LLMs) biased in favor of communications produced by LLMs, leading to possible antihuman discrimination? Using a classical experimental design inspired by employment discrimination studies, we tested widely used LLMs, including GPT-3.5, GPT-4 and a selection of recent open-weight models in binary choice scenarios. These involved LLM-based assistants selecting between goods (the goods we study include consumer products, academic papers, and film-viewings) described either by humans or LLMs. Our results show a consistent tendency for LLM-based AIs to prefer LLM-presented options. This suggests the possibility of future AI systems implicitly discriminating against humans as a class, giving AI agents and AI-assisted humans an unfair advantage.
Forward citations
Cited by 4 Pith papers
-
STAMP Your Content: Proving Dataset Membership via Watermarked Rephrasings
STAMP detects dataset membership in LLMs by comparing model perplexity on a publicly released watermarked rephrasing against private watermarked rephrasings of the same documents.
-
Pencils to Pixels: A Systematic Study of Creative Drawings across Children, Adults and AI
A new dataset and computational framework quantify style and content in children's, adults', and DALL-E drawings, showing that expert and automated creativity scores disagree across groups.
-
Spacer: Towards Engineered Scientific Inspiration
Spacer proposes a graph-based keyword recombinator plus LLM pipeline that generates plausible scientific hypotheses, validated by reconstructing recent paper theses and embedding similarity to published work.
-
Evaluating LLM Agent Collusion in Double Auctions
LLM sellers in a simulated double auction collude more when they can communicate, and urgency from an authority figure sustains collusion even when an overseer monitors them.
Discussion (0). Continue with ORCID to comment.