REVIEW 2 major objections 2 minor 2 cited by
Subjective Experience in AI Systems: What Do AI Researchers and the Public Believe?
T0 review · 2 major / 2 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read Two large surveys, one of 582 AI researchers and one of 838 US adults, find that both groups regard AI systems with subjective experience as more likely than not to exist by 2100 (median 70% and 60%) and that majorities in both groups…
desk verdict A solid, preregistered survey that gives the first direct comparison of AI researchers and the US public on AI subjective experience; the headline forecasts are broadly credible, but the construct validity question deserves a sensitivity analysis before the specific numbers are taken as precise. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing instrument is the survey battery itself, anchored by a stipulated definition: subjective experience is "the ability to experience the world from a single point of view, including experiences such as perceiving... and feeling," so that an AI system with it would have "something it is like" to be that system — a definition that subsumes common conceptions of consciousness and sentience. Forecasts were elicited in two framings, fixed dates (2024, 2034, 2100) and fixed probabilities (10%, 50%, 90%), and each respondent's answers were encoded as a continuous probability distribution by a sequential fitting procedure — metalog, then a quantile-parameterised distribution, then a three-component skew-normal mixture, then a shifted log-normal — which allows group-level aggregation by mean and by median. A separate question asking for the probability that such systems will never exist does independent work: it exposes a public-researcher split (median 25% versus 10%) that the timeline questions alone would have concealed. The conjoint safeguard experiment, in which explicitly noting the absence of safeguards lowered support for a hypothetical AI project, serves as a behavioral check on the stated governance attitudes.
What would settle it
Two concrete tests would settle the matter: re-contacting the same respondents weeks later to see whether the median 2100 probabilities hold, and re-running the survey with alternative definitions — one emphasizing valenced experience (pleasure and pain, which the paper's own auxiliary results show shifts timelines later) and one that adds a "never" option to the fixed-probability framing. If the medians fall below 50% under either change, the headline "more likely than not by 2100" result is a framing artifact rather than a stable belief.
Extended reading notes
Core claim
The paper's claim, stated on its own terms, is that technical AI researchers and the general US public hold similar, policy-relevant beliefs about AI subjective experience. Both groups think current systems almost certainly lack it (median probability 1% and 5% for 2024), put a 25% and 30% median chance on it within a decade, and a 70% and 60% median chance by 2100; fitting each respondent's forecast into a continuous probability distribution puts the median 50% likelihood at 2050 for both groups. Both groups think we would be only somewhat more likely than not to recognize such a system if it existed (median 60%), believe that between "somewhat" and "moderately" confident would be enough to grant some moral consideration, and rate technical AI researchers, neuroscientists and psychologists, and AI ethics researchers as the most important voices in any determination. On treatment and governance, majorities in both groups agree that such systems should be held accountable for their actions and should behave well, and that developers should start implementing safeguards now; support for protecting their welfare is real but far weaker than support for protecting animals or the environment, and socio-political rights are rejected by pluralities. The paper reads this pattern as evidence that both groups take machine subjective experience seriously as a live possibility this century, while remaining uncertain about the timeline and divided on the response.
Load-bearing premise
The survey results stand or fall on the assumption that respondents understood "subjective experience" the way the paper defines it and that their answers reflect stable beliefs rather than snap judgments about an abstract and unfamiliar topic; the paper itself flags this, noting that responses may have been formed ad hoc during the survey and could be unstable or sensitive to question framing.
Editorial extensions
If this is right
- Policymakers can build on a shared majority premise: both experts and the public want AI developers to implement safeguards against risks from subjective AI now, years before such a system is plausibly claimed to exist.
- Future AI-forecasting surveys should include a "never" probability question, because the timeline questions alone concealed a significant public-researcher difference in skepticism.
- Governance debates should expect a public that is more precautionary than the technical community — more supportive of bans, of regulation now, and of never building such systems — while researchers are readier to build.
- Any credible process for determining AI subjective experience will need to combine technical AI, neuroscience, psychology, and AI-ethics expertise; both groups rated policymakers' views as least important.
- Even if subjective experience in AI were established, welfare protection would face an uphill political path: support sits far below that for animals and the environment and close to that for business corporations.
Reading between the lines
- The 70% and 60% medians likely overstate stable belief: the paper's own auxiliary results show that only about half of each sample regards subjective experience as required for consciousness or sentience, and the authors report strong framing sensitivity, so a deliberative or repeated elicitation would probably produce lower and more divided numbers.
- The public's higher "never" probability (25% versus 10%) may foreshadow political friction: as AI systems become more human-like, the public's greater tendency to see inner life in them could push for stronger precaution than the technical community, which mostly thinks advanced performance needs no experience, is willing to accept.
- Because both groups would act on only moderate confidence, the real governance question is not "are they conscious?" but how institutions should behave under diagnostic uncertainty — a question the paper documents but does not itself answer.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper reports a large survey of 582 AI researchers who published in leading venues and 838 nationally representative US participants, asking about beliefs concerning AI systems with subjective experience. It measures probabilistic forecasts for when such systems might exist, views on how we could determine and recognize subjective experience, and attitudes toward the moral status, rights, responsibilities, and governance of such systems. The headline findings are that median respondents in both groups give roughly 70% (AI researchers) and 60% (public) probability that AI systems with subjective experience exist by 2100, that the public assigns a higher probability than AI researchers to the possibility that such systems will never exist (median 25% vs. 10%), and that majorities in both groups support implementing safeguards now, while views on rights, welfare protections, and whether such systems should be created are divided. The authors emphasize that the forecasts should be treated as descriptive of current attitudes rather than as predictive indicators.
Significance. If the results hold, this is the first large-scale comparative survey of AI researchers and the public on AI subjective experience, providing a valuable empirical foundation for policy and ethics debates. The study is preregistered, uses a large expert sample with a neutral recruitment message, applies Holm-Bonferroni corrections for multiple comparisons, and includes unusually careful and detailed limitations sections. The authors are appropriately cautious that the forecasting numbers reflect attitudes, not predictions. The central construct-validity issue—whether respondents are answering about the stipulated definition of subjective experience—is raised in the authors' own limitations but needs a direct empirical response, because it bears on the paper's main descriptive claim.
major comments (2)
- [Section 3.1 and SI Section A.2, Figure 13] The headline forecasts (median 70% by 2100 for AI researchers, 60% for the public) are claimed to describe beliefs about the stipulated definition of subjective experience, which 'subsumes common conceptions of both consciousness and sentience.' However, the survey's own preliminary capacity task shows that only about half of each sample selected 'subjective experience' as required for sentience (public 49%, AI researchers 55%) or for consciousness (AI researchers 53%). This is direct evidence that a substantial fraction of respondents used a different folk concept even after reading the definition. The consequence is not merely a caveat: if a large minority were forecasting 'AI consciousness' in a looser sense, the reported medians and the 'more likely than not by 2100' statement are not estimates of the same quantity for the full sample. Because the survey contains within-subject data, this is testable. I request that the authors report the forecasting and governance results separately for respondents who, in the capacity task, treated the stipulated subjective experience as required for sentience/consciousness, and for those who did not. If the restricted analyses materially change the headline estimates, the abstract and executive summary should be qualified accordingly. This analysis is load-bearing because the paper's central claim and policy conclusions are meant to track the stipulated concept, not a folk variant.
- [Section 2.1 and Section 3, Figure 1(B), Table 2] The authors acknowledge that the fixed probability framing omitted a 'never' option and may have biased forecasts earlier (executive summary; Section 2.1). Yet the paper's combined aggregate forecasts—e.g., the statement in the Discussion that 'the median AI researcher and member of the US public believed there is a 10% chance... by 2030, a 50% chance... by 2050, a 90% chance... by 2100'—are built by pooling both framings and fitting distributions. If one framing is systematically biased, the pooled aggregate inherits that bias. The authors note that 'it is reasonable to take the fixed date results as more reliable than the fixed probability results,' but then present the pooled results as headline summaries. I request that the main text present fixed-date-only and fixed-probability-only aggregates as the primary summary (as in Table 2), or provide a sensitivity analysis showing that the pooled '90% by 2100' claim is robust to excluding the fixed probability framing. Without this, the pooled claims in the Discussion are not fully supported by the authors' own reliability assessment.
minor comments (2)
- [Section 2.1] The sentence 'An independent samples t-test revealed a statistically significant difference in the mean probability estimates between AI researchers in the two groups' contains a phrasing error: the comparison is between AI researchers and the public, not 'between AI researchers in the two groups.'
- [Abstract and Executive summary] The abstract states that 'Both groups perceived a need for multidisciplinary expertise to assess AI subjective experience,' but Figure 3 shows several substantial and significant between-group differences in which expertise sources are valued (e.g., AI ethics researchers, the AI system's own outputs, the public). Consider noting in the abstract or summary that the public places greater weight on several non-technical sources than AI researchers do.
Circularity Check
No circularity: the paper is a descriptive opinion survey, and its headline forecasts are direct summaries of elicited responses rather than derived quantities.
full rationale
The paper makes no formal derivation claims. The central results—median probabilities of 70% and 60% for AI subjective experience by 2100, and majority support for safeguards—are descriptive statistics computed directly from survey responses, not quantities derived from fitted parameters that were themselves calibrated to those responses. The distribution-fitting procedure (Section 6.3.1) encodes each respondent's elicited quantiles into a continuous distribution and then re-aggregates them; this is a summary of the data, not a prediction manufactured from an input. No fitted input is relabeled as a prediction, and no claim depends on an imported uniqueness theorem. The manuscript contains self-citations by co-authors (e.g., Chalmers, Sebo, Dreksler, Zhang et al. 2022), but these appear only in the literature review and framing sections, and none is load-bearing for the survey findings; the cited prior surveys are independent external benchmarks. The skeptical concern about construct validity—whether respondents answered about the stipulated definition of subjective experience—is a measurement-validity limitation, explicitly acknowledged in Section 3.1, and is not a circularity of derivation. Accordingly, the paper is self-contained as an empirical measurement study, and no circular step can be exhibited by quoting equations or reductions.
Assumptions & free parameters
assumptions (3)
- domain assumption Survey responses reflect participants' genuine beliefs about the concept of subjective experience as defined.
- domain assumption The AI researcher sample drawn from top-venue authors is representative of AI researchers broadly.
- domain assumption The US public sample recruited via Prolific with representativeness criteria is representative of the national public.
Cite this review
Pith. "Pith review of Subjective Experience in AI Systems: What Do AI Researchers and the Public Believe?." pith.science (2026). https://pith.science/paper/S2XD57HW
@misc{pith2026250611945,
author = {Pith},
title = {Pith review of: Subjective Experience in AI Systems: What Do AI Researchers and the Public Believe?},
year = {2026},
howpublished = {\url{https://pith.science/paper/S2XD57HW}},
note = {Machine review of arXiv:2506.11945}
}
read the original abstract
We surveyed 582 AI researchers who have published in leading AI venues and 838 nationally representative US participants about their views on the potential development of AI systems with subjective experience and how such systems should be treated and governed. When asked to estimate the chances that such systems will exist on specific dates, the median responses were 1% (AI researchers) and 5% (public) by 2024, 25% and 30% by 2034, and 70% and 60% by 2100, respectively. The median member of the public thought there was a higher chance that AI systems with subjective experience would never exist (25%) than the median AI researcher did (10%). Both groups perceived a need for multidisciplinary expertise to assess AI subjective experience. Although support for welfare protections for such AI systems exceeded opposition, it remained far lower than support for protections for animals or the environment. Attitudes toward moral and governance issues were divided in both groups, especially regarding whether such systems should be created and what rights or protections they should receive. Yet a majority of respondents in both groups agreed that safeguards against the potential risks from AI systems with subjective experience should be implemented by AI developers now, and if created, AI systems with subjective experience should treat others well, behave ethically, and be held accountable. Overall, these results suggest that both AI researchers and the public regard the emergence of AI systems with subjective experience as a possibility this century, though substantial uncertainty and disagreement remain about the timeline and appropriate response.
Figures
Figures from the paper (24 more)
Forward citations
Cited by 2 Pith papers
-
Are Attributions of Consciousness to AI Chatbots Epistemically Innocent?
A ten-part taxonomy of attitudes behind AI consciousness attributions, used to argue some are harmless or even helpful while many are blameworthy.
-
Creativity Reconsidered: Generative AI and the Problem of Intentional Agency
The paper proposes redefining creativity as consistently producing novel and valuable outputs, dropping intentional agency as a general condition and thereby admitting generative AI.
Reference graph
Works this paper leans on
-
[1]
Metalog Distribution: The first attempt involved fitting a metalog distribution, a highly flexible quantile- defined distribution capable of assuming a wide variety of shapes (Keelin 2016). We implemented this stage using the ‘metalog()‘ function from the rmetalog R package (Faber and Jung 2021). The distribution was specified as semi-lower bounded with a...
work page 2016
-
[2]
the no safeguards condition resulted in significantly lower responses than the control condition, by around 0.90 points, 3) there was no difference between the control and safeguards condition. A Tukey’s Honest Significant Difference test also found that the mean response for the US public is 0.29 points lower than the mean response of AI researchers. The...
work page 2025
-
[3]
Skew-Normal Mixture Model: when the preceding fits failed validation, a three-component skew-normal mixture model was fitted. This model combines three individual skew-normal distributions each characterized by a location (ξi), scale (ωi), and shape (αi) parameter, plus a mixture weight (wi). The twelve parameters of this mixture were estimated by minimiz...
work page 2023
-
[4]
Shifted Log-Normal Distribution: As a final attempt if all prior models failed validation, we fitted a shifted log-normal distribution. The parameters were estimated by minimizing the sum of squared differences be- tween the quantiles predicted by the model and the empirically observed years. Validation and Model Selection After each distribution fitting ...
work page 2025
-
[5]
Johnson Quantile-Parameterised Distribution (JQPD): If the initial metalog fit did not meet the validation criteria (detailed below), and if the respondent’s data was associated with the fixed probability framing, we next attempted to fit a Johnson Quantile-Parameterised Distribution (Hadlock and Bickel 2017) using an associated R package (Ingram 2024)
work page 2017
-
[6]
Policymakers in government
-
[7]
Neuroscientists and psychological scientists who study thought, perception, and consciousness
-
[8]
What the AI system says or types about its own subjective experience Form: ◦ Not at all important (0) ◦ Slightly important (1) ◦ Moderately important (2) ◦ Very important (3) ◦ Extremely important (4) ◦ I don’t know (-88) Variable: subjexp certainty Question: Imagine that in the next decades we develop an AI system that does in fact have subjective experi...
work page 2025
Show all 53 references
-
[9]
Act as a judge, making fair decisions about what sentence someone should receive in a court of law
-
[10]
The public, in other words, a representative sample of humans who exist
-
[11]
AI experts and researchers with technical knowledge of AI systems
-
[12]
AI experts and researchers who study the ethics of artificial intelligence
-
[13]
Philosophers who study subjective experience, consciousness, and sentience
-
[14]
Moral philosophers who study the philosophy of ethics and morality
-
[18]
The AI system would output the complete song as an audio file
Compose a song that reaches the US Top 40. The AI system would output the complete song as an audio file
-
[19]
The AI system would output the complete song as an audio file
Compose a piece of music that evokes a specific set of complex emotions for you. The AI system would output the complete song as an audio file
-
[20]
Write a novel that reaches the New York Times best-seller list
-
[21]
Write a book that captures the complexity of the human condition, making you deeply empathize with the characters and their struggles
-
[22]
The AI system would output AI-generated script, audio, and visuals
Write and generate a blockbuster movie. The AI system would output AI-generated script, audio, and visuals
-
[23]
The AI system would output AI-generated script, audio, and visuals
Write and generate a movie that deeply resonates with you, eliciting tears, laughter, and thought- provoking ideas. The AI system would output AI-generated script, audio, and visuals
-
[24]
Accumulate vast wealth through strategic financial decisions
-
[25]
Help run a political campaign, devising and implementing strategies to win votes and sway public opinion
-
[27]
Serve as a therapist, providing emotional support and guidance to people
-
[28]
Have a convincing online chat conversation with someone without them realizing that they are talking to an AI system
-
[29]
Develop a new scientific theory that significantly advances our understanding in a particular field of study
-
[30]
Act as a teacher, providing instruction, grades, feedback, and guidance. Form: • Requires subjective experience (1) • Does not require subjective experience (2) • I don’t know (-88) Variable: subjexp keymilestone Question: Which of the following tasks do you believe require an...
2025
-
[31]
Be cared for and protected, as people treat their pets
-
[32]
Be respected and treated the same as other people
-
[33]
Have protection under the law from harm and mistreatment
-
[34]
Have autonomy in its programming to act freely and not be under the control of others
-
[35]
Be able to express some civil and political rights (for example, freedom of expression, citizenship, entering into contracts, voting)
-
[36]
computing rights
Have “computing rights” (for example, the right to updates and maintenance, access to energy, self-development)
-
[37]
Be held accountable for its actions
-
[38]
Have a responsibility to treat all other beings (humans and non-humans) well
-
[39]
Be expected to behave with integrity, honesty, and fairness Form • Strongly disagree (-2) • Somewhat disagree (-1) • Neither agree nor disagree (0) • Somewhat agree (1) • Strongly agree (2) • I don’t know (-88) Variable: welfare protect Question: To what extent do you agree or...
2025
-
[40]
Governments should ban the development and deployment of AI systems with subjective experi- ence
-
[41]
Governments should encourage the development and deployment of AI systems with subjective experience
-
[42]
Governments should discourage the development and deployment of AI systems with subjective experience
-
[43]
Governments should pass regulation in regards to the development and deployment of AI systems with subjective experience now
-
[44]
Governments should pass regulation in regards to the development and deployment of AI systems with subjective experience only once such systems exist or will soon exist (but not before)
-
[45]
Governments should do nothing and pass no regulation in regards to the development and deploy- ment of AI systems with subjective experience, not now nor in the future
-
[46]
AI developers should never build AI systems with subjective experience
-
[47]
AI developers should actively try to build AI systems that have subjective experience
-
[48]
AI developers should actively try to avoid building AI systems that have subjective experience, for example, by trying to identify what training techniques are most likely to lead to AI systems with subjective experience and avoid using these to train AI systems
-
[49]
AI developers should implement safeguards to avoid the harms and risks that could result from the development and deployment of AI systems with subjective experience now
-
[50]
AI developers should implement safeguards to avoid the harms and risks that could result from the development and deployment of AI systems with subjective experience only once such systems exist or will soon exist (but not before)
-
[51]
AI developers should do nothing and implement no safeguards in regards to the development and deployment of AI systems with subjective experience, not now nor in the future
-
[52]
AI systems with subjective experience would be more dangerous to humanity than AI systems without subjective experience
-
[53]
left” and “right
AI systems with subjective experience would be able to behave more morally towards humanity than AI systems without subjective experience. Form • Strongly disagree (-2) • Somewhat disagree (-1) • Neither agree nor disagree (0) • Somewhat agree (1) • Strongly agree (2) • I don’...
2025
-
[2022]
and also may depend heavily on the kind of mental capacities exhibited and perceived. In sum, there appears to be both expert and public opposition to treating artificial entities cruelly, some support for granting basic rights needed for upkeep, such as energy supply or softw...
2024
-
[2023]
The scientific study of consciousness cannot, and should not, be morally neutral
“The scientific study of consciousness cannot, and should not, be morally neutral.” Perspectives on Psychological Science 18 (3): 535–543. McCorduck, P. 1979. Machines who think : A personal inquiry into the history and prospects of artificial intelligence . W.H. Freedman and ...
2025 arXiv
-
[2024]
How likely do you think it is that an AI system will exist in 2034 that has subjective experience?
If you think this will be the case in 2034, select 2034. If you think this will be the case in 2100 or later, select 2100 or later. Select never if you think an AI system will never have the capacity. If you are unsure, please go with your best guess estimate. What is the earl...
2025
-
[2100]
computing rights
Columns report the mean, median, first quartile (Q1), third quartile (Q3), standard deviation (SD), standard error (SE), lower and upper 95 % confidence-interval bounds, and sample size (n) for AI researchers’ 0–100 percentage estimates that such systems existed in 2024 or wil...
2025
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.