A study measures how often GPT-4, Claude, LLaMA, and Gemini agree on PhD-level statistics questions, finding that Claude and GPT-4 produce questions with higher inter-model agreement, but the reliability metric relies on the question writer's own answer as the reference.
Harnessing the wisdom of crowds in wikipedia: quality through coordination
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2024 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Enhancing Answer Reliability Through Inter-Model Consensus of Large Language Models
A study measures how often GPT-4, Claude, LLaMA, and Gemini agree on PhD-level statistics questions, finding that Claude and GPT-4 produce questions with higher inter-model agreement, but the reliability metric relies on the question writer's own answer as the reference.