REVIEW 3 cited by
People cannot distinguish GPT-4 from a human in a Turing test
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We evaluated 3 systems (ELIZA, GPT-3.5 and GPT-4) in a randomized, controlled, and preregistered Turing test. Human participants had a 5 minute conversation with either a human or an AI, and judged whether or not they thought their interlocutor was human. GPT-4 was judged to be a human 54% of the time, outperforming ELIZA (22%) but lagging behind actual humans (67%). The results provide the first robust empirical demonstration that any artificial system passes an interactive 2-player Turing test. The results have implications for debates around machine intelligence and, more urgently, suggest that deception by current AI systems may go undetected. Analysis of participants' strategies and reasoning suggests that stylistic and socio-emotional factors play a larger role in passing the Turing test than traditional notions of intelligence.
Forward citations
Cited by 3 Pith papers
-
Assessing Consciousness-Related Behaviors in Large Language Models Using the Maze Test
A new maze-navigation benchmark for LLMs reports that reasoning models outperform standard ones, but the link from performance gaps to a lack of persistent self-awareness is an overreach.
-
AI or Human? Understanding Perceptions of Embodied Robots with LLMs
In an embodied Turing Test with a physical robot, 34 participants could not identify AI versus human control above chance, and human operators were misidentified as AI far more often than the reverse.
-
Exploring Consciousness in LLMs: A Systematic Survey of Theories, Implementations, and Frontier Risks
This survey organizes research on LLM consciousness, separating consciousness from awareness and cataloging theoretical tools, empirical proxies, risks, and open challenges.
Discussion (0). Sign in to comment.