REVIEW 3 major objections 5 minor 45 references
AI or Human? Understanding Perceptions of Embodied Robots with LLMs
T0 review · 3 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read This paper claims that people cannot reliably tell whether an embodied robot is steered by a large language model or by a human teleoperator, and that they systematically over-attribute human behavior to AI.
desk verdict First embodied verbal Turing Test with an LLM-driven robot against a teleoperated human; the null result and misidentification asymmetry are worth attention, but the two-person baseline and clustered statistics keep it from being definitive. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is an embodied Turing Test built on the IVO robot with two matched operator channels. The AI channel uses GPT-4o-mini for dialogue generation plus Retrieval-Augmented Generation (RAG) with LaBSE embeddings grounded in a document about a university building; the human channel uses two remote teleoperators who receive the same document and are instructed to follow it. Both channels feed the same text-to-speech system, and the AI's response timing is artificially delayed to mimic human typing speed. Movement, person tracking, and arm control are shared and triggered by either operator, so the conversational output is the variable under test. The questionnaire, adapted from a prior LLM Turing Test study, asks participants to choose AI or human, rate confidence on a 1-10 scale, and select reasons for their judgment.
What would settle it
Replicate the Turing Test with unscripted human operators who answer from their own knowledge and personality. If participants then identify the operator correctly significantly more often than chance (for example, above 60%), the claim that people cannot tell AI from human operators would be falsified; if the human-misclassified-as-AI asymmetry disappears under unscripted operators, the bias interpretation would also be called into question.
Extended reading notes
Core claim
The paper's central claim is that in an embodied Turing Test with an LLM-controlled robot, people cannot reliably distinguish AI from human operators. The evidence is a binomial test on 136 judgments: 52.21% correct is not significantly different from 50% ($p=0.334$). The secondary claim is that the two error types are not symmetric: participants misclassified human operators as AI far more often than the reverse, with a chi-square of $\chi^2=34.07$ ($p=5.33\times10^{-9}$). The authors also find that task type and robot movement mode did not affect accuracy, that RAG kept the LLM's factual errors low (8 hallucinations in 64 AI interactions), and that when hallucinations occurred, participants correctly identified the AI in 6 of 8 cases. They interpret the asymmetry as evidence that people associate AI with formality, politeness, and scripted behavior, so human operators who follow guidelines and sound formal are judged to be machines.
Load-bearing premise
The central claim depends on the human operators being representative of natural human interaction, but they were only two people instructed to answer strictly from a document and to 'establish trust,' and the paper itself notes their behavior at times resembled machines; if that baseline is artificial, the result compares two scripted systems rather than AI versus human.
Editorial extensions
If this is right
- If people cannot tell the operator apart, an embodied LLM robot is already indistinguishable from a human teleoperator in short, task-oriented conversations, including when the robot is moving.
- The misclassification asymmetry implies the practical risk is over-attribution of AI: human operators acting under guidelines are judged to be machines, which could affect trust in human-operated remote services.
- Response timing and linguistic formality are the cues that drive judgments, so robot designers who want to be perceived as human should soften formality and vary response delays.
- RAG appears to keep the LLM factually reliable, while the rare hallucinations expose the AI; further reducing hallucinations would make the AI channel harder to detect.
- Accuracy did not improve across repeated interactions in the study, suggesting familiarity with the robot by itself does not teach people to spot the AI; training or performance feedback may be needed.
Reading between the lines
- If the human baseline is unrepresentative—only two operators, both instructed to stick to a document and to 'establish trust'—then the result may describe how people classify machine-like behavior rather than a genuine AI–human equivalence; a naturalistic human baseline is the next test.
- The confidence pattern (accuracy rising with confidence for the AI but falling for the human operator) suggests people carry overconfident stereotypes about what AI sounds like; collecting a continuous 'how AI-like is this response' rating before the binary choice would test this directly.
- Because robot movement mode made no difference, the results predict that conversational content dominates in embodied Turing Tests; an extension that varies physical behavior while holding the dialogue fixed would test that prediction.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper reports an embodied Turing Test with the IVO robot. Thirty-four participants each completed four interactions (two tasks crossed with static and dynamic modes), with operator type as a between-subjects factor: 17 interacted with an LLM (GPT-4o-mini with RAG) and 17 with one of two human teleoperators. After each interaction, participants guessed whether the operator was AI or human. The headline result is that participants identified the operator correctly in 71/136 trials (52.21%), a non-significant binomial test (p=0.334); the paper also reports a strong asymmetry in errors (human operators misclassified as AI 50 times versus AI operators misclassified as human 15 times; chi-square=34.07, p=5.33e-9), alongside analyses of confidence, reasons, demographics, and conversational data. The authors conclude that humans cannot reliably distinguish AI- from human-operated robots beyond chance and tend to over-attribute AI.
Significance. If the central claims are robust, the study is a meaningful extension of LLM Turing Tests from text-only settings to embodied interaction involving navigation and manipulation, and it provides a clear, falsifiable result plus an asymmetry that could inform HRI design. The study has several strengths: it uses a physical robot, two functionally different tasks, three interaction languages, a transparent prompt-design process informed by a pilot study, an explicit response-delay model (Eq. 1), and evaluation by independent participants who did not know the operator assignment. I found no circular-reasoning issue: the pilot-based prompt and delay parameter are imported design choices rather than outcome variables, and the chance-level result is not encoded in the prompt. The significance is currently conditional, however, because the principal statistical claims rest on trial-level tests that ignore the nested data structure.
major comments (3)
- [Section IV.A] The headline null result (71/136 correct, binomial p=0.334) treats the 136 judgments as independent trials. The design described in Section III.D has each of 34 participants contributing four judgments, and operator type is constant within a participant; trials are therefore clustered within participants and the operator factor is between-subjects. If accuracy varies across participants, the effective number of independent observations is closer to 34 than 136, and the reported p-value is not valid as a test of the chance-level claim. Please report per-participant accuracy, an intraclass correlation, a mixed-effects logistic regression with participant as a random effect, and/or a participant-level binomial test, or provide raw data so the clustering can be independently assessed. This is load-bearing because the abstract and title state the chance-level result as the central finding.
- [Section IV.A] The asymmetry result (50 human-as-AI misidentifications versus 15 AI-as-human, chi-square=34.07, p=5.33e-9) is computed on the aggregate 2x2 table without accounting for repeated measures. Since operator type is between-subjects, the 50 and 15 counts could be driven by a small number of participants who consistently misjudged one operator type. Please report the per-participant distribution of misidentifications (for example, counts of participants making 0-4 errors for each operator type) and provide a clustered test, such as a participant-level Mann-Whitney or Wilcoxon test on the number of misidentifications, or a mixed-effects model, before treating the asymmetry as robust.
- [Section III.C.1 and Section V.B] The human baseline is limited to two operators who were instructed to answer only from a provided document in the information task and to 'establish trust' during the handover task. The paper itself acknowledges in Section V.B that these human operators 'exhibited even stronger formal tendencies than the AI' and that when they 'strictly follow the guidelines, their behavior at times resembles that of machines.' As written, the conclusion that people cannot distinguish AI- from human-controlled robots generalizes beyond what the data support; the comparison is between an LLM and a highly constrained teleoperation protocol. Please reframe the central claim to state this boundary condition explicitly, or supplement the baseline with additional, less-constrained operators, and discuss how the null result might differ with a more natural human baseline.
minor comments (5)
- [Abstract and general text] The abstract and several other places contain typographical and grammatical errors, including 'associated to the the challenge,' 'system intelligence,' and 'participants responses'; a careful proofread is needed.
- [Section III.C.2, Eq. (1)] The notation N(0.3, 0.03) should be explicitly defined as a Gaussian random variable, and the text should state whether the delay is drawn once per response or per character and how negative or near-zero draws are handled.
- [Section IV.A] The reported p=0.334 appears to be a one-tailed binomial probability for the direction 'better than chance'; since the text says 'no significant deviation from 50%,' the two-tailed p-value should also be reported for consistency with the wording.
- [Section IV.C] The correlation claims involving age and chatbot interaction frequency are based on small subgroups (n_ind=6, 4, 4, 20) and are presented without a correlation coefficient or confidence interval; please report the relevant statistic or use a model that accounts for participant clustering.
- [Figure 3] The figure would be easier to interpret if the text specified whether the shaded 95% confidence interval is computed per participant or per trial and how the confidence-level groupings were formed.
Circularity Check
No significant circularity: the central claim is an empirical result from independent participants and does not reduce by construction to the system's fitted or imported parameters.
full rationale
The paper's central claim—that participants could not distinguish AI- from human-operated robots beyond chance (71/136 correct, binomial p=0.334)—is an empirical outcome measured on independent participant judgments, not a quantity encoded in the experimental setup. The AI operator's prompt was informed by a pilot study of human responses, and the response-delay model (Eq. 1) is an imported design parameter, but neither the prompt nor the delay model enforces the chance-level outcome or the misidentification asymmetry; these are contingent results of the data collection. The human baseline is constrained (two operators following strict guidelines), which the authors acknowledge in Section V.B, but this is a validity threat about the representativeness of the comparison, not a circular reduction of the derivation to its inputs. The few self-citations (e.g., the IVO robot reference [37]) concern the hardware platform and are not load-bearing for the perceptual claim. No fitted parameter is renamed as a prediction, no uniqueness theorem is imported from the authors' prior work, and no known result is merely re-renamed. The statistical critique that trials may not be independent is a methodological concern about the inference, not a circularity in the derivation chain.
Assumptions & free parameters
free parameters (2)
- response delay scale =
0.3 s/char (N(0.3, 0.03) per character plus 1 s minimum)
- LLM temperature =
1
assumptions (3)
- domain assumption Human teleoperators following the task instructions produce behavior representative of natural human interaction.
- domain assumption The 136 interaction samples are independent Bernoulli trials in the binomial test.
- domain assumption The speech pipeline preserves operator identity cues without systematic bias.
Cite this review
Pith. "Pith review of AI or Human? Understanding Perceptions of Embodied Robots with LLMs." pith.science (2026). https://pith.science/paper/B65OM2D5
@misc{pith2026250716398,
author = {Pith},
title = {Pith review of: AI or Human? Understanding Perceptions of Embodied Robots with LLMs},
year = {2026},
howpublished = {\url{https://pith.science/paper/B65OM2D5}},
note = {Machine review of arXiv:2507.16398}
}
read the original abstract
The pursuit of artificial intelligence has long been associated to the the challenge of effectively measuring intelligence. Even if the Turing Test was introduced as a means of assessing a system intelligence, its relevance and application within the field of human-robot interaction remain largely underexplored. This study investigates the perception of intelligence in embodied robots by performing a Turing Test within a robotic platform. A total of 34 participants were tasked with distinguishing between AI- and human-operated robots while engaging in two interactive tasks: an information retrieval and a package handover. These tasks assessed the robot perception and navigation abilities under both static and dynamic conditions. Results indicate that participants were unable to reliably differentiate between AI- and human-controlled robots beyond chance levels. Furthermore, analysis of participant responses reveals key factors influencing the perception of artificial versus human intelligence in embodied robotic systems. These findings provide insights into the design of future interactive robots and contribute to the ongoing discourse on intelligence assessment in AI-driven systems.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
Frames of mind: The theory of multiple intelli- gences
Gardner, Howard E. Frames of mind: The theory of multiple intelli- gences. Basic books, 2011
work page 2011
-
[2]
A survey of large language models
Zhao, Wayne Xin, et al. "A survey of large language models." arXiv preprint arXiv:2303.18223 1.2 (2023)
arXiv 2023
-
[3]
Large language models for robotics: A survey
Zeng, Fanlong, et al. "Large language models for robotics: A survey." arXiv preprint arXiv:2311.07226 (2023)
arXiv 2023
-
[4]
Latte: Language trajectory transformer
Bucker, Arthur, et al. "Latte: Language trajectory transformer." 2023 IEEE international conference on robotics and automation (ICRA). IEEE, 2023
work page 2023
-
[5]
Prompt a robot to walk with large language models
Wang, Yen-Jen, et al. "Prompt a robot to walk with large language models." 2024 IEEE 63rd Conference on Decision and Control (CDC). IEEE, 2024
work page 2024
-
[6]
Real-time emotion generation in human- robot dialogue using large language models
Mishra, Chinmaya, et al. "Real-time emotion generation in human- robot dialogue using large language models." Frontiers in Robotics and AI 10 (2023): 1271610
work page 2023
-
[7]
Exploring collaboration mechanisms for llm agents: A social psychology view
Zhang, Jintian, et al. "Exploring collaboration mechanisms for llm agents: A social psychology view." arXiv preprint arXiv:2310.02124 (2023)
arXiv 2023
-
[8]
Progprompt: Generating situated robot task plans using large language models
Singh, Ishika, et al. "Progprompt: Generating situated robot task plans using large language models." 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023
work page 2023
Show all 45 references
-
[9]
Embodiment in socially interactive robots
Deng, Eric, Bilge Mutlu, and Maja J. Mataric. "Embodiment in socially interactive robots." Foundations and Trends® in Robotics 7.4 (2019): 251-356
2019
-
[10]
Computing machinery and intelligence
Turing, Alan M. Computing machinery and intelligence. Springer Netherlands, 2009
2009
-
[11]
The Turing Test: the first 50 years
French, Robert M. "The Turing Test: the first 50 years." Trends in cognitive sciences 4.3 (2000): 115-122
2000
-
[12]
I-athlon: Towards a multidimensional Turing Test
Adams, Sam S., Guruduth Banavar, and Murray Campbell. "I-athlon: Towards a multidimensional Turing Test." AI Magazine 37.1 (2016): 78-84
2016
-
[13]
Software social organisms: Implications for measuring AI progress
Forbus, Kenneth D. "Software social organisms: Implications for measuring AI progress." AI Magazine 37.1 (2016): 85-90
2016
-
[14]
Measuring machine intelligence through visual question answering
Zitnick, C. Lawrence, et al. "Measuring machine intelligence through visual question answering." AI Magazine 37.1 (2016): 63-72
2016
-
[15]
Turing++ questions: A test for the science of (human) intelligence
Poggio, Tomaso, and Ethan Meyers. "Turing++ questions: A test for the science of (human) intelligence." AI Magazine 37.1 (2016): 73-77
2016
-
[16]
The social-emotional Turing challenge
Jarrold, William, and Peter Z. Yeh. "The social-emotional Turing challenge." AI magazine 37.1 (2016): 31-38
2016
-
[17]
Why we need a physically embodied Turing Test and what it might look like
Ortiz Jr, Charles L. "Why we need a physically embodied Turing Test and what it might look like." AI magazine 37.1 (2016): 55-62
2016
-
[18]
The benefits of interactions with physi- cally present robots over video-displayed agents
Bainbridge, Wilma A., et al. "The benefits of interactions with physi- cally present robots over video-displayed agents." International Journal of Social Robotics 3 (2011): 41-52
2011
-
[19]
Poor thing! Would you feel sorry for a simulated robot? A comparison of empathy toward a physical and a simulated robot
Seo, Stela H., et al. "Poor thing! Would you feel sorry for a simulated robot? A comparison of empathy toward a physical and a simulated robot." Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. 2015
2015
-
[20]
Investigating the effects of physical and virtual embodiment in task-oriented and conversational contexts
Hoffmann, Laura, and Nicole C. Krämer. "Investigating the effects of physical and virtual embodiment in task-oriented and conversational contexts." International Journal of Human-Computer Studies 71.7-8 (2013): 763-774
2013
-
[21]
The role of physical embodiment in human- robot interaction
Wainer, Joshua, et al. "The role of physical embodiment in human- robot interaction." ROMAN 2006-The 15th IEEE International Sym- posium on Robot and Human Interactive Communication. IEEE, 2006
2006
-
[22]
Human-like behavioral variability blurs the distinction between a human and a machine in a nonverbal Turing Test
Ciardo, Francesca, Davide De Tommaso, and Agnieszka Wykowska. "Human-like behavioral variability blurs the distinction between a human and a machine in a nonverbal Turing Test." Science robotics 7.68 (2022): eabo1241
2022
-
[23]
Large language models for robotics: Opportuni- ties, challenges, and perspectives
Wang, Jiaqi, et al. "Large language models for robotics: Opportuni- ties, challenges, and perspectives." arXiv preprint arXiv:2401.04334 (2024)
2024 arXiv
-
[24]
Human or Not? A Gamified Approach to the Turing Test
Jannai, Daniel, et al. "Human or Not? A Gamified Approach to the Turing Test.” arXiv." arXiv preprint arXiv:2305.20010 (2023)
2023 arXiv
-
[25]
Does GPT-4 pass the Turing Test?
Jones, Cameron, and Ben Bergen. "Does GPT-4 pass the Turing Test?." Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (V olume 1: Long Papers). 2024
2024
-
[26]
People cannot dis- tinguish GPT-4 from a human in a Turing Test
Jones, Cameron R., and Benjamin K. Bergen. "People cannot dis- tinguish GPT-4 from a human in a Turing Test." arXiv preprint arXiv:2405.08007 (2024)
2024 arXiv
-
[27]
Turingbench: A benchmark environment for Turing Test in the age of neural text generation
Uchendu, Adaku, et al. "Turingbench: A benchmark environment for Turing Test in the age of neural text generation." arXiv preprint arXiv:2109.13296 (2021)
2021 arXiv
-
[28]
The science of detecting LLM-generated text
Tang, Ruixiang, Yu-Neng Chuang, and Xia Hu. "The science of detecting LLM-generated text." Communications of the ACM 67.4 (2024): 50-59
2024
-
[29]
A survey on LLM-generated text detection: Necessity, methods, and future directions
Wu, Junchao, et al. "A survey on LLM-generated text detection: Necessity, methods, and future directions." Computational Linguistics (2025): 1-66
2025
-
[30]
GPT-4 is judged more human than humans in displaced and inverted Turing Tests
Rathi, Ishika, et al. "GPT-4 is judged more human than humans in displaced and inverted Turing Tests." arXiv preprint arXiv:2407.08853 (2024)
2024 arXiv
-
[31]
Methods for haptic feedback in teleoperated robot-assisted surgery
Okamura, Allison M. "Methods for haptic feedback in teleoperated robot-assisted surgery." Industrial Robot: An International Journal 31.6 (2004): 499-508
2004
-
[32]
A compact modular teleoperated robotic system for laparoscopic surgery
Berkelman, Peter, and Ji Ma. "A compact modular teleoperated robotic system for laparoscopic surgery." The International journal of robotics research 28.9 (2009): 1198-1215
2009
-
[33]
Keep healthcare workers safe: application of teleoperated robot in isolation ward for COVID-19 prevention and control
Yang, Geng, et al. "Keep healthcare workers safe: application of teleoperated robot in isolation ward for COVID-19 prevention and control." Chinese Journal of Mechanical Engineering 33 (2020): 1-4
2020
-
[34]
Robotics and ai for teleoperation, tele-assessment, and tele-training for surgery in the era of covid-19: Existing chal- lenges, and future vision
Feizi, Navid, et al. "Robotics and ai for teleoperation, tele-assessment, and tele-training for surgery in the era of covid-19: Existing chal- lenges, and future vision." Frontiers in Robotics and AI 8 (2021): 610677
2021
-
[35]
Teleoperated robot coaching for mindfulness training: A longitudinal study
Bodala, Indu P., Nikhil Churamani, and Hatice Gunes. "Teleoperated robot coaching for mindfulness training: A longitudinal study." 2021 30th IEEE international conference on robot & human interactive communication (RO-MAN). IEEE, 2021
2021
-
[36]
Teleoperated robot acting autonomous for better cus- tomer satisfaction
Baba, Jun, et al. "Teleoperated robot acting autonomous for better cus- tomer satisfaction." Extended Abstracts of the 2020 CHI conference on human factors in computing systems. 2020
2020
-
[37]
Ivo robot: A new social robot for human- robot collaboration
Laplaza, Javier, et al. "Ivo robot: A new social robot for human- robot collaboration." 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 2022
2022
-
[38]
Robotics
O. Robotics. ROS 2 Documentation: Humble. [Accessed 24 Mar 2025] https://docs.ros.org/en/humble/
2025
-
[39]
V osk Speech Recognition Toolkit: Offline Speech Recognition API for Android, iOS, Raspberry Pi, and Servers with Python, Java, C#, and Node
Shmyrev, Nickolay V ., et al. V osk Speech Recognition Toolkit: Offline Speech Recognition API for Android, iOS, Raspberry Pi, and Servers with Python, Java, C#, and Node. GitHub, 2020, [Accessed 24 Mar 2025] https://github.com/alphacep/vosk-api
2020
-
[40]
GPT Models: 4-o-mini
OpenAI. GPT Models: 4-o-mini. OpenAI [Accessed 24 Mar 2025] https://platform.openai.com/docs/models/gpt-4o-mini
2025
-
[41]
Durette, Pierre N., gTTS-Google Text-to-Speech, [Accessed 24 Mar 2025] https://pypi.org/project/gTTS/
2025
-
[42]
On multi-modal people tracking from mobile platforms in very crowded and dynamic environments
Linder, Timm, et al. "On multi-modal people tracking from mobile platforms in very crowded and dynamic environments." 2016 IEEE international conference on robotics and automation (ICRA). IEEE, 2016
2016
-
[43]
Retrieval-augmented generation for knowledge- intensive nlp tasks
Lewis, Patrick, et al. "Retrieval-augmented generation for knowledge- intensive nlp tasks." Advances in Neural Information Processing Systems 33 (2020): 9459-9474
2020
-
[44]
Language-agnostic BERT sentence embed- ding
Feng, Fangxiaoyu, et al. "Language-agnostic BERT sentence embed- ding." arXiv preprint arXiv:2007.01852 (2020)
2020 arXiv
-
[45]
ROS Development Team. (n.d.). RViz. Robot Operating System (ROS). [Accessed 24 Mar 2025] http://wiki.ros.org/rviz
2025
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.