Generative AI and Two-Tiered Online Mental Health Communities
Pith reviewed 2026-05-21 09:28 UTC · model grok-4.3
The pith
Generative AI integration in two-tier mental health platforms increases counselor posting intensity by expanding patient demand and competitive incentives.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Leveraging the timing of genAI agent integration as a quasi-natural experiment, the study shows that counselor posting intensity increases significantly after AI entry, with activity partially reallocated from non-AI subforums, average response length unchanged, and per-post social recognition declining. Mechanism tests link the rise to improved platform responsiveness and enlarged patient engagement. Counselors respond heterogeneously, with intrinsically motivated ones reducing participation and economically motivated ones intensifying competitive effort. This produces cross-tier spillovers: inactive counselors see declines in paid consultations, while those increasing public participation
What carries the argument
The two-tier platform structure separating public forums from paid consultations, with AI integration treated as an exogenous shock that expands the patient pool and shifts counselor incentives.
If this is right
- Counselor posting activity rises because AI expands the set of patients seeking help and creates competitive pressure to respond.
- Economically motivated counselors increase their forum participation to capture the new demand, while intrinsic ones reduce theirs.
- Counselors who raise public activity maintain or expand their downstream paid consultation volume.
- Inactive counselors experience reduced paid consultation demand as patients engage more through the AI layer.
- Activity reallocates from nearby non-AI subforums toward the integrated platform without changing average response length.
Where Pith is reading between the lines
- The same demand-expansion logic could apply to other tiered professional platforms such as legal Q&A sites or educational tutoring services.
- Platform operators might design hybrid incentive systems that reward human experts for handling cases escalated from AI responses.
- Longer-term studies could test whether sustained counselor activity improves patient outcomes beyond the short-run participation effects observed here.
- Platforms without a clear paid tier might experience stronger crowding-out if AI fully substitutes for initial human contact.
Load-bearing premise
The rollout of the generative AI agent can be treated as an exogenous shock isolated from concurrent platform changes or selection effects that would bias counselor behavior estimates.
What would settle it
Finding no increase in counselor posting intensity or no preservation of paid consultations for active counselors after AI integration in a similar two-tier platform would undermine the central claim.
read the original abstract
Online mental health communities (OMHCs) are tiered platforms that connect patients with licensed counselors through public Q&A forums and paid private consultations. Their two-tier structure creates a strategic dilemma for genAI integration. Conversational agents can provide scalable and timely responses to a broader set of patients, alleviating persistent supply shortages, but their large-scale presence may also reshape counselors' participation in providing nuanced expertise, emotionally sensitive support, and paid consultations, which are central to platform revenue and long-run sustainability. Leveraging a quasi-natural experiment from the integration of a genAI-based conversational agent in a leading OMHC, we examine how AI entry affects counselor participation. Using multiple identification strategies, we find that posting intensity increases significantly after AI integration, while average response length remains unchanged and per-post social recognition declines. Mechanism analyses show that AI improves responsiveness and expands patient engagement, enlarging counselors' opportunity sets, with activity partially reallocated from a nearby non-AI subforum. Counselors respond heterogeneously: intrinsically motivated counselors reduce participation, whereas economically motivated counselors intensify competitive effort. These dynamics generate cross-tier spillovers: inactive counselors experience declines in paid consultations, while those who increase public participation preserve or expand downstream demand. Overall, our findings show that in tiered professional platforms, demand expansion and competitive incentives can outweigh intrinsic crowding-out.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript examines the effects of integrating a generative AI conversational agent into a leading two-tiered online mental health community (OMHC) platform, which combines public Q&A forums with paid private consultations. Using a quasi-natural experiment around the AI rollout and multiple identification strategies, the authors find that counselor posting intensity rises significantly post-integration while average response length stays constant and per-post social recognition falls. Mechanism tests indicate improved responsiveness, expanded patient engagement, and partial activity reallocation from a non-AI subforum. Counselors respond heterogeneously by motivation type (intrinsically motivated counselors reduce effort; economically motivated ones increase competitive posting), generating cross-tier spillovers where inactive counselors lose paid consultations but active ones preserve or expand downstream demand. The central claim is that demand expansion and competitive incentives outweigh intrinsic crowding-out.
Significance. If the causal identification is valid, the paper contributes to platform economics and labor studies by providing evidence that AI can expand opportunity sets for professionals in tiered systems rather than purely displacing them, with direct implications for mental health platform design and sustainability. The heterogeneity analysis by counselor motivation and the documented spillovers to paid consultations add empirical nuance to crowding-out debates. The use of mechanism tests strengthens interpretability beyond reduced-form results.
major comments (2)
- [§4] §4 (Identification Strategies): The quasi-natural experiment relies on the AI rollout timing being exogenous, yet the manuscript provides insufficient detail on concurrent platform changes, marketing efforts, or selection into counselor participation that could confound the estimated rise in posting intensity and the reallocation patterns from the non-AI subforum.
- [Mechanism Analyses] Mechanism Analyses and Results: The conclusion that demand expansion outweighs crowding-out hinges on the reported increases in patient engagement and cross-tier spillovers to paid consultations; without sample sizes, exact econometric specifications, or robustness checks shown for these tests, the magnitude and causal attribution of these effects cannot be fully evaluated.
minor comments (2)
- [Abstract] Abstract: Including approximate effect sizes (e.g., percentage change in posting intensity) would improve the reader's ability to gauge economic significance.
- [Introduction] Introduction: The distinction between intrinsically and economically motivated counselors should be operationalized with explicit criteria or survey measures earlier to clarify the heterogeneity results.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback and for recognizing the paper's potential contribution to platform economics and labor studies in the context of AI integration. We address each major comment below and outline planned revisions to strengthen the manuscript.
read point-by-point responses
-
Referee: [§4] §4 (Identification Strategies): The quasi-natural experiment relies on the AI rollout timing being exogenous, yet the manuscript provides insufficient detail on concurrent platform changes, marketing efforts, or selection into counselor participation that could confound the estimated rise in posting intensity and the reallocation patterns from the non-AI subforum.
Authors: We agree that greater transparency on the identification strategy is warranted. The manuscript already describes the quasi-natural experiment and multiple identification strategies, but we will expand Section 4 in the revision to include a detailed event timeline drawn from platform records, confirming no concurrent major changes or marketing campaigns coincided with the rollout. We will also clarify that the AI tool was made available to all counselors without selection criteria and add robustness checks using matched samples to address potential participation biases. revision: yes
-
Referee: [Mechanism Analyses] Mechanism Analyses and Results: The conclusion that demand expansion outweighs crowding-out hinges on the reported increases in patient engagement and cross-tier spillovers to paid consultations; without sample sizes, exact econometric specifications, or robustness checks shown for these tests, the magnitude and causal attribution of these effects cannot be fully evaluated.
Authors: We thank the referee for this observation. The main text and tables report sample sizes and core specifications for the mechanism tests on patient engagement and cross-tier spillovers. To address the request for fuller documentation, we will add an appendix in the revision containing the complete econometric specifications (including all controls and fixed effects), exact sample sizes for each test, and additional robustness checks such as alternative time windows and placebo analyses. revision: yes
Circularity Check
No circularity: purely empirical identification on observational data
full rationale
The paper reports results from a quasi-natural experiment on AI rollout timing in an OMHC platform, using multiple identification strategies to estimate changes in counselor posting intensity, response length, patient engagement, and cross-tier spillovers. No theoretical derivation, first-principles model, or fitted functional form is claimed; the central findings rest on external timing variation treated as exogenous and on mechanism tests that do not reduce to the same fitted parameters. No self-citations, ansatzes, or renamings appear as load-bearing steps in any derivation chain. The analysis is therefore self-contained against external data variation.
Axiom & Free-Parameter Ledger
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Leveraging a quasi-natural experiment from the integration of a genAI-based conversational agent... Using multiple identification strategies, we find that posting intensity increases significantly after AI integration
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Phang, Chee Wei and Kankanhalli, Atreyi and Tan, Bernard C. Y. , title =. Information Systems Research , volume =. 2015 , type =
work page 2015
-
[2]
Huang, Ni and Hong, Yili and Burtch, Gordon , title =. MIS Quarterly , volume =. 2017 , type =
work page 2017
-
[3]
Burtch, Gordon and Hong, Yili and Bapna, Ravi and Griskevicius, Vladas , title =. Management Science , volume =. 2018 , type =
work page 2018
-
[4]
Qiao, Dandan and Lee, Shun-Yang and Whinston, Andrew B. and Wei, Qiang , title =. Information Systems Research , volume =. 2020 , type =
work page 2020
-
[5]
Information Systems Research , volume =
Lin, Zhijie and Zhang, Ying and Tan, Yong , title =. Information Systems Research , volume =. 2019 , type =
work page 2019
- [6]
-
[7]
Journal of Consumer Research , volume =
Longoni, Chiara and Bonezzi, Andrea and Morewedge, Carey K , title =. Journal of Consumer Research , volume =. 2019 , type =
work page 2019
-
[8]
Yang, Yikai and Ngai, Eric W. T. and Wang, Lei , title =. Information & Management , volume =. 2024 , type =
work page 2024
-
[9]
Information Systems Research , volume =
Fan, Wenjuan and Zhou, Qiqi and Qiu, Liangfei and Kumar, Subodha , title =. Information Systems Research , volume =. 2022 , type =
work page 2022
-
[10]
Production and Operations Management , volume =
Yan, Zhijun and Kuang, Lini and Qiu, Liangfei , title =. Production and Operations Management , volume =. 2022 , type =
work page 2022
-
[11]
Information Systems Research , volume =
Khurana, Sandeep and Qiu, Liangfei and Kumar, Subodha , title =. Information Systems Research , volume =. 2019 , type =
work page 2019
-
[12]
Computers in Human Behavior , volume =
Guan, Tao and Wang, Le and Jin, Jiahua and Song, Xiaolong , title =. Computers in Human Behavior , volume =. 2018 , type =
work page 2018
-
[13]
Human Communication Research , volume =
Feng, Bo , title =. Human Communication Research , volume =. 2009 , type =
work page 2009
-
[14]
Annual Review of Clinical Psychology , volume =
Lebowitz, Matthew S and Appelbaum, Paul S , title =. Annual Review of Clinical Psychology , volume =. 2019 , type =
work page 2019
-
[15]
Psychotherapy Research , volume =
Nienhuis, Jacob B and Owen, Jesse and Valentine, Jeffrey C and Winkeljohn Black, Stephanie and Halford, Tyler C and Parazak, Stephanie E and Budge, Stephanie and Hilsenroth, Mark , title =. Psychotherapy Research , volume =. 2018 , type =
work page 2018
-
[16]
Yin, Y. and Jia, N. and Wakslak, C. J. , title =. Proceedings of the National Academy of Sciences of the United States of America , volume =. 2024 , type =
work page 2024
-
[17]
The sourcebook of listening research: Methodology and measures , pages =
Reis, Harry T and Crasta, Dev and Rogge, Ronald D and Maniaci, Michael R and Carmichael, Cheryl L , title =. The sourcebook of listening research: Methodology and measures , pages =. 2017 , type =
work page 2017
-
[18]
Uncertainty, information management, and disclosure decisions: Theories and applications
Greene, Kathryn , title =. Uncertainty, information management, and disclosure decisions: Theories and applications. , publisher =. 2009 , type =
work page 2009
-
[19]
Information Systems Research , volume =
Wang, Qili and Qiu, Liangfei and Xu, Wei , title =. Information Systems Research , volume =. 2023 , type =
work page 2023
-
[20]
Deng, Yiting and Lambrecht, Anja and Liu, Yongdong , title =. Management Science , volume =. 2023 , type =. doi:10.1287/mnsc.2022.4619 , url =
-
[21]
Noy, Shakked and Zhang, Whitney , title =. Science , volume =. 2023 , type =
work page 2023
-
[22]
Information Systems Research , volume =
Khern-am-nuai, Warut and Ghasemkhani, Hossein and Qiao, Dandan and Kannan, Karthik , title =. Information Systems Research , volume =. 2024 , type =
work page 2024
-
[23]
Journal of marketing Research , volume =
Weiss, Allen M and Lurie, Nicholas H and MacInnis, Deborah J , title =. Journal of marketing Research , volume =. 2008 , type =
work page 2008
-
[24]
Cem and Chintagunta, Pradeep K
Ozturk, O. Cem and Chintagunta, Pradeep K. and Venkataraman, Sriram , title =. Marketing Science , volume =. 2019 , type =
work page 2019
-
[25]
Clark, Andrew E and Doyle, Orla and Stancanelli, Elena , title =. Economic Journal , volume =. 2020 , type =
work page 2020
-
[26]
Journal of Marketing Research , volume =
Banerjee, Shrabastee and Dellarocas, Chrysanthos and Zervas, Georgios , title =. Journal of Marketing Research , volume =. 2021 , type =
work page 2021
-
[27]
Information Systems Research , volume =
Zhang, Shunyuan and Singh, Param Vir and Ghose, Anindya , title =. Information Systems Research , volume =. 2019 , type =
work page 2019
-
[28]
Available at SSRN: https://ssrn.com/abstract=4628786 , year =
Su, Yi and Zhang, Kaiyu and Wang, Qili and Qiu, Liangfei , title =. Available at SSRN: https://ssrn.com/abstract=4628786 , year =
-
[29]
Available at SSRN 4686658 , year =
Yuan, Ziqing and Chen, Hailiang , title =. Available at SSRN 4686658 , year =
-
[30]
Information Systems Research , volume =
Lysyakov, Mikhail and Viswanathan, Siva , title =. Information Systems Research , volume =. 2023 , type =
work page 2023
-
[31]
Thirunavukarasu, Arun James and Ting, Darren Shu Jeng and Elangovan, Kabilan and Gutierrez, Laura and Tan, Ting Fang and Ting, Daniel Shu Wei , title =. Nature medicine , volume =. 2023 , type =
work page 2023
-
[32]
Wasko, Molly McLure and Faraj, Samer , title =. MIS quarterly , pages =. 2005 , type =
work page 2005
-
[33]
Annual Review of Resource Economics , volume =
Hausman, Catherine and Rapson, David S , title =. Annual Review of Resource Economics , volume =. 2018 , type =
work page 2018
-
[34]
and Greene, David and Nisbett, Richard E
Lepper, Mark R. and Greene, David and Nisbett, Richard E. , title =. Journal of Personality and Social Psychology , volume =. 1973 , type =
work page 1973
-
[35]
Sen, Ananya and Grad, Tom and Ferreira, Pedro and Claussenb, Joerg , title =. Management Science , volume =. 2024 , type =
work page 2024
-
[36]
Information Systems Research , volume =
Majchrzak, Ann and Malhotra, Arvind , title =. Information Systems Research , volume =. 2016 , type =
work page 2016
-
[37]
Chen, Wei and Wei, Xiahua and Zhu, Kevin Xiaoguo , title =. MIS Quarterly , volume =. 2018 , type =
work page 2018
-
[38]
Huang, Ni and Burtch, Gordon and Gu, Bin and Hong, Yili and Liang, Chen and Wang, Kanliang and Fu, Dongpu and Yang, Bo , title =. Management Science , volume =. 2019 , type =
work page 2019
-
[39]
Rishika, Rishika and Ramaprasad, Jui , title =. Management Science , volume =. 2019 , type =
work page 2019
-
[40]
Information Systems Research , volume =
Guo, Chenhui and Kim, Tae Hun and Susarla, Anjana and Sambamurthy, Vallabh , title =. Information Systems Research , volume =. 2020 , type =
work page 2020
-
[41]
Journal of Management Information Systems , volume =
Chen, Kun and Fan, Yifan and Liao, Shaoyi Stephen , title =. Journal of Management Information Systems , volume =. 2023 , type =
work page 2023
-
[42]
Liao, Gen-Yih and Huang, Tzu-Ling and Dennis, Alan R. and Teng, Ching- I. , title =. Information Systems Research , volume =. 2024 , type =
work page 2024
-
[43]
Journal of Management Information Systems , volume =
Guo, Shanshan and Guo, Xitong and Fang, Yulin and Vogel, Doug , title =. Journal of Management Information Systems , volume =. 2017 , type =
work page 2017
-
[44]
and Guo, Chenhui and Lin, Mingfeng , title =
Goes, Paulo B. and Guo, Chenhui and Lin, Mingfeng , title =. Information Systems Research , volume =. 2016 , type =
work page 2016
-
[45]
Ray, Soumya and Kim, Sung S. and Morris, James G. , title =. Information Systems Research , volume =. 2014 , type =
work page 2014
-
[46]
Cong, Ziwei and Zhao, Ying and Zhang, Zilei , title =. Marketing Science , volume =. 2025 , pages =
work page 2025
-
[47]
Goh, Jie Mein and Gao, Guodong and Agarwal, Ritu , title =. MIS Quarterly , volume =. 2016 , type =
work page 2016
-
[48]
and Lin, Mingfeng and Yeung, Ching-man Au , title =
Goes, Paulo B. and Lin, Mingfeng and Yeung, Ching-man Au , title =. Information Systems Research , volume =. 2014 , type =
work page 2014
-
[49]
Wasko, M. M. and Faraj, S. , title =. MIS Quarterly , volume =. 2005 , type =
work page 2005
-
[50]
Information Systems Research , volume =
Lin, Yu-Kai and Rai, Arun and Yang, Yukun , title =. Information Systems Research , volume =. 2022 , type =
work page 2022
-
[51]
Information Systems Research , volume =
Gnewuch, Ulrich and Morana, Stefan and Hinz, Oliver and Kellner, Ralf and Maedche, Alexander , title =. Information Systems Research , volume =. 2024 , type =
work page 2024
-
[52]
Wang, W. G. and Gao, G. D. and Agarwal, R. , title =. Management Science , year =
-
[53]
Deng, Yipu and Zheng, Jinyang and Khern-am-nuai, Warut and Kannan, Karthik , title =. Management Science , volume =. 2022 , type =
work page 2022
-
[54]
Deci, Edward L. and Ryan, Richard M. , title =. Psychological Inquiry , volume =
-
[55]
Incentives and Prosocial Behavior , journal =
B. Incentives and Prosocial Behavior , journal =
- [56]
- [57]
- [58]
-
[59]
Dellarocas, Chrysanthos , title =. Management Science , volume =
-
[60]
Is a core-periphery network good for knowledge sharing?
Lu, Yingda and Singh, Param Vir and Sun, Baohong , journal=. Is a core-periphery network good for knowledge sharing?. 2017 , publisher=
work page 2017
-
[61]
Yang, Bicheng and Chan, Tat and Owan, Hideo and Tsuru, Tsuyoshi , title =. Management Science , volume =. 2024 , type =
work page 2024
-
[62]
Xu, Yuqian and Dai, Hongyan and Yan, Wanfeng , title =. Management Science , volume =. 2024 , type =
work page 2024
- [63]
-
[64]
Manufacturing & Service Operations Management , volume =
Hou, Ting and Li, Meng and Tan, Yinliang and Zhao, Huazhong , title =. Manufacturing & Service Operations Management , volume =. 2024 , type =
work page 2024
-
[65]
Information Systems Research , volume =
Han, Elizabeth and Yin, Dezhi and Zhang, Han , title =. Information Systems Research , volume =. 2023 , type =
work page 2023
-
[66]
Organization Science , volume =
Hui, Xiang and Reshef, Oren and Zhou, Luofeng , title =. Organization Science , volume =. 2024 , type =
work page 2024
- [67]
-
[68]
Li, Peiyao and Castelo, Noah and Katona, Zsolt and Sarvary, Miklos , title =. Marketing Science , volume =. 2024 , type =
work page 2024
-
[69]
Chen, Zenan and Chan, Jason , title =. Management Science , volume =. 2024 , type =
work page 2024
-
[70]
Zhou, Lexin and Schellaert, Wout and Martínez-Plumed, Fernando and Moros-Daval, Yael and Ferri, Cèsar and Hernández-Orallo, José , title =. Nature , volume =. 2024 , type =
work page 2024
-
[71]
Yang, M. C. and Ren, Y. Q. and Adomavicius, G. , title =. Information Systems Research , volume =. 2019 , type =
work page 2019
-
[72]
Journal of the American statistical Association , volume =
Abadie, Alberto and Diamond, Alexis and Hainmueller, Jens , title =. Journal of the American statistical Association , volume =. 2010 , type =
work page 2010
-
[73]
Journal of the Royal Statistical Society Series A: Statistics in Society , volume =
Lechner, Michael , title =. Journal of the Royal Statistical Society Series A: Statistics in Society , volume =. 2002 , type =
work page 2002
-
[74]
Information Systems Research , volume =
Fan, Wenjuan and Zhou, Qiqi and Qiu, Liangfei and Kumar, Subodha , title =. Information Systems Research , volume =. 2023 , type =
work page 2023
-
[75]
Information Systems Research , volume =
Liang, Huigang and Xue, Yajiong , title =. Information Systems Research , volume =. 2022 , type =
work page 2022
- [76]
-
[77]
The Quarterly Journal of Economics , pages =
Brynjolfsson, Erik and Li, Danielle and Raymond, Lindsey , title =. The Quarterly Journal of Economics , pages =. 2025 , type =
work page 2025
-
[78]
and Zhang, Miaomiao and Jacimovic, Vladimir and Lakhani, Karim R
Boussioux, Leonard and Lane, Jacqueline N. and Zhang, Miaomiao and Jacimovic, Vladimir and Lakhani, Karim R. , title =. Organization Science , volume =. 2024 , type =
work page 2024
-
[79]
Doshi, Anil R. and Bell, J. Jason and Mirzayev, Emil and Vanneste, Bart S. , title =. Strategic Management Journal , volume =. 2025 , type =
work page 2025
-
[80]
Sharma, Ashish and Lin, Inna W. and Miner, Adam S. and Atkins, David C. and Althoff, Tim , title =. Nature Machine Intelligence , volume =. 2023 , type =
work page 2023
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.