REVIEW 3 major objections 7 minor 132 references
Thoughtful, Confused, or Untrustworthy: How Text Presentation Influences Perceptions of AI Writing Tools
T0 review · 3 major / 7 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read AI text speed shifts users' trust and quality judgments.
desk verdict A well-designed study of how text streaming speed shapes perceptions of AI writing tools, but the analysis ignores the within-subjects structure and the small 'perceived quality' effect needs a reanalysis before that claim is taken seriously. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the text presentation style, operationalized as five within-subject conditions: slow (160 wpm), medium (600 wpm, near average reading speed), fast (6,000 wpm, approximating large language model token generation), backwards (characters appear in reverse), and random (characters inserted in random order), with the content held fixed. These conditions isolate the perceptual contribution of appearance speed and order from the meaning of the text. The mechanism is that users read along with the appearing text, so the pace and order either match or disrupt their reading process, producing comfort or discomfort and cueing human-like versus machine-like attributions.
What would settle it
A replication in which participants actually write their own text and receive unique AI completions, with the same speed conditions, would falsify the generalization if the medium-speed advantage on quality and trust disappears. A simpler check: have readers rate the final complete texts without seeing the animation; if speed-blind ratings still differ by condition, the effect would be in the content, not the presentation.
Extended reading notes
Core claim
The central discovery is that the speed and order of text appearance affect users' perceptions of an AI writing tool independently of the text content. In the experiment, the identical text presented at medium speed was rated highest on comfort and quality; slow and medium speeds were perceived as more human-like; and the two deliberately non-anthropomorphic styles—backwards and random character order—were rated as less trustworthy. The authors report that users read along with the generation, attribute human-like qualities such as thoughtfulness to slower appearance, and show divided preferences tied to their writing values rather than a consistent genre effect. Their conclusion is that interface presentation decisions influence judgments of system quality and trustworthiness, and thereby influence how generated text is used.
Load-bearing premise
The study's load-bearing premise is that imagining oneself as a co-writer produces the same perceptions as actually writing; the authors note that imagining does not create the same experience as writing, so the measured effects may not extend to real writing sessions.
Editorial extensions
If this is right
- Medium-speed text appearance, near average reading speed, produces the highest reading comfort and perceived text quality; designers who want favorable quality judgments should not default to maximum speed.
- Backwards and random text presentation reduce perceived trustworthiness and quality, so non-anthropomorphic streaming styles carry a perception cost even when the final text is identical.
- Slow and medium speeds make the AI seem more human-like; users may accept more output from tools that appear thoughtful, a consequence the authors flag as potentially unintentional manipulation.
- Text presentation effects on comfort, quality, humanness, and trust were not substantially moderated by genre, indicating the effects are not confined to one writing context.
- Because perceptions influence use, tools that display text too fast or too slowly may change how much users scrutinize suggestions, influencing acceptance and rejection decisions.
Reading between the lines
- The authors' setup fixes the text content; an untested extension is whether the same perceptual effects appear when users write their own text and receive personalized completions, where involvement and ownership may override presentation cues.
- If the trust effect holds in real use, one testable design response is to decouple display speed from model computation speed and let users set the pace, which would break the current coupling between latency optimization and perception.
- The findings suggest a concrete hypothesis for neighboring domains: adding human-like pauses or backspacing to AI output, as some tools already do, may increase perceived thoughtfulness and thereby raise acceptance rates of fallible content.
- A direct follow-up prediction: blind evaluators who rate the same final texts without seeing the animation should show no speed effect, confirming that the effect lives in presentation rather than content.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper examines how the presentation style of AI-generated text (speed and character order) affects users' perceptions of an AI writing tool. In an online study with 297 participants, each participant saw five text appearance conditions (slow, medium, fast, backwards, random) in two genres (creative, professional) and rated reading comfort, perceived text quality, humanness, trust, respect, liking, and intention to use. The authors report that medium speed is most comfortable and yields the highest perceived quality, slow and medium are perceived as most human-like, forward presentation is more trustworthy than backwards or random, and that genre shows no consistent interaction. The paper includes qualitative thematic analysis and an exploratory appendix.
Significance. If the reported effects are valid, this work makes a meaningful contribution to HCI and AI interface design by demonstrating that a seemingly cosmetic design choice—the speed and order of streamed AI text—can change users' judgments of output quality and trustworthiness. The study's strengths include pre-registered-style hypothesis finalization one month before data collection, fixed texts, randomized speed-text pairs, a within-subjects design, Bonferroni correction, and an ART robustness check. The large comfort effect (η²p = 0.19) is substantial and the qualitative findings are rich. However, a serious statistical flaw—the analysis treats repeated-measures data as independent observations—undermines the reported p-values and post-hoc groupings, particularly for the small effects such as perceived quality. The central qualitative narrative is likely defensible, but the quantitative evidence needs to be re-analyzed before the paper can be accepted.
major comments (3)
- [Section 4.3.1 / Section 5.1–5.4] The statistical analysis treats each of the 2970 trials (297 participants × 10 within-subject trials) as independent observations. The reported error df of 4,2965 for presentation style corresponds to N = 2970 independent observations, not to the repeated-measures structure described in Section 4.1, where every participant saw all five styles in both genres. This inflates the test statistics and invalidates the exact p-values, effect sizes, and Tukey post-hoc letter groupings. This is load-bearing for the paper's smaller effects, especially H2 (perceived quality: η²p = 0.02, medium-minus-fast mean gap 0.14 on a -2 to 2 scale) and for H4–H8. Please re-analyze with a mixed-effects model (participant as a random effect, with scenario/genre as appropriate) or a repeated-measures ANOVA, and report corrected F, p, effect sizes, and post-hoc comparisons. The Aligned Rank Transform robustness check must also account for the within-subjects design. The large comfort and humanness effects may survive, but the exact numbers and the abstract's claim about perceived quality are not trustworthy as reported.
- [Section 5.2 (H2) and Section 7] The statement that medium presentation 'resulted in the highest perceived quality' is a post-hoc finding from pairwise comparisons after a null-hypothesis ANOVA (H2 predicted no effect). Once the repeated-measures analysis is correctly performed, the post-hoc comparisons must be recomputed with the proper error terms. The abstract and conclusion should reflect the corrected results, and any claim that speed is 'correlated with' quality should be expressed as a perceptual effect conditional on the corrected analysis.
- [Sections 3.3 and 5.4] The hypotheses H4, H6, and H8 explicitly involve genre-by-presentation interactions (e.g., fast for professional, slow/medium for creative), yet the results sections do not report the interaction term's F and p values. The conclusion states 'we do not find evidence of a consistent interaction between text appearance speed and genre system,' but the basis for this claim is not presented. Please report the interaction F, df, and p for each dependent variable, or explicitly state that interactions were not tested and adjust the interpretation accordingly.
minor comments (7)
- [Abstract] The abstract says 'speed is correlated with perceived humanness and trustworthiness of the AI tool, as well as the perceived quality of the generated text.' This is imprecise because the manipulated factor is presentation style, which includes character order (backwards, random) as well as speed; 'correlated' is also weaker than the experimental design allows—suggest 'affected' or 'influenced'.
- [Section 3.1.1 (Medium)] Medium is described as 'slightly faster than average reading speed,' but the cited reference in Section 2.2 gives average reading speeds of 200–400 wpm; 600 wpm is 1.5 to 3 times that range. Please revise the justification for the medium anchor.
- [Section 3.1.1 (Random)] The description 'random insertion via insertion-sort' is unclear, because insertion sort is a deterministic ordering algorithm, not a random insertion process. Please clarify the exact character placement procedure.
- [Section 4.3.1] The phrase 'independent multi-way ANOVAs' is ambiguous and could be read as 'independent-observations ANOVAs,' which is precisely the problem described above. Consider renaming to 'separate ANOVAs' and explicitly noting the need for a repeated-measures approach.
- [Table 2] For the genre rows in H2, H4, H5, and H8, significant p-values are shown as '***' but no compact letter display is provided; the text says post-hoc comparisons were conducted for significant ANOVAs. Please add the corresponding letter groupings or explain why they are omitted.
- [Figure 2] The figure contains placeholder text such as '/gid00035' that appears to be a rendering artifact; please replace these strings with proper textual labels.
- [Section 6.3] The limitation about 'imagining writing does not create the same experience as writing' is appropriately acknowledged. Consider explicitly tying this to the quantitative results—e.g., effects might differ when users are actively composing rather than reading prefilled text.
Circularity Check
No circularity: an empirical perception study with hypotheses grounded in prior literature, no fitted parameters, no self-citation load-bearing derivation, and no prediction that reduces to its inputs.
full rationale
This paper is an empirical user study, not a derivation or modeling paper. The central claims—that text appearance speed affects perceived comfort, quality, humanness, trustworthiness, and adoption attitudes—are tested through a preregistered-style experiment with five presentation-speed conditions and two genres. The independent variables are constructed from display latencies and character orders, and the dependent variables are Likert-scale survey responses. There is no equation that maps inputs to outputs, no fitted parameter that is later renamed as a prediction, and no uniqueness theorem or ansatz imported from the authors' prior work to force a conclusion. The hypotheses in Sec. 3.3 are grounded in external literature (speech-rate perception, reading speed, typing-speed research, trust and anthropomorphism studies) and are stated before data collection; the paper explicitly notes hypotheses and the analysis plan were finalized one month prior to data collection. The qualitative analysis in Sec. 4.3.2 uses inductive thematic analysis, which is not a derivation. The acknowledged limitations in Sec. 6.3 (imagined rather than actual writing; character-by-character rather than token-by-token appearance) are threats to external validity or generalizability, not circularity. The skeptic's concern about repeated-measures data being analyzed as independent observations (df 4,2965) is a statistical correctness or robustness issue; it does not make any claimed result equivalent by construction to its inputs. Accordingly, no circular steps are present, and the appropriate score is 0.
Assumptions & free parameters
free parameters (4)
- Slow speed anchor =
160 wpm
- Medium speed anchor =
600 wpm
- Fast speed anchor =
6000 wpm
- Backwards/Random order at 600 wpm =
600 wpm, non-forward order
assumptions (4)
- domain assumption ANOVA is robust to Likert scale non-normality
- domain assumption Randomized speed-text pairing isolates presentation from content
- domain assumption Genre systems frame captures meaningful differences between creative and professional writing
- domain assumption Participants read along with the AI generation as the mechanism for comfort
Cite this review
Pith. "Pith review of Thoughtful, Confused, or Untrustworthy: How Text Presentation Influences Perceptions of AI Writing Tools." pith.science (2026). https://pith.science/paper/R37QK2EY
@misc{pith2026250420365,
author = {Pith},
title = {Pith review of: Thoughtful, Confused, or Untrustworthy: How Text Presentation Influences Perceptions of AI Writing Tools},
year = {2026},
howpublished = {\url{https://pith.science/paper/R37QK2EY}},
note = {Machine review of arXiv:2504.20365}
}
read the original abstract
AI writing tools have been shown to dramatically change the way people write, yet the effects of AI text presentation are not well understood nor always intentionally designed. Although text presentation in existing large language model interfaces is linked to the speed of the underlying model, text presentation speed can impact perceptions of AI systems, potentially influencing whether AI suggestions are accepted or rejected. In this paper, we analyze the effects of varying text generation speed in creative and professional writing scenarios on an online platform (n=297). We find that speed is correlated with perceived humanness and trustworthiness of the AI tool, as well as the perceived quality of the generated text. We discuss its implications on creative and writing processes, along with future steps in the intentional design of AI writing tool interfaces.
Figures
Reference graph
Works this paper leans on
-
[1]
Megha Agarwal, Asfandyar Qureshi, Nikhil Sardana, Linden Li, Julian Quevedo, and Daya Khudia. 2023. LLM Inference Performance Engineering: Best Practices. https://www.databricks.com/blog/llm-inference-performance- engineering-best-practices
2023
-
[2]
Philip E Agre. 2014. Toward a critical technical practice: Lessons learned in trying to reform AI. In Social science, technical systems, and cooperative work . Psychology Press, 131–157
2014
-
[3]
Teresa M Amabile. 1983. The social psychology of creativity: A componential conceptualization. Journal of Personality and Social Psychology 45(2) (1983), 357–376
1983
-
[4]
Anthropic. 2024. Claude. https://claude.ai/
2024
-
[5]
Arnold, Krysta Chauncey, and Krzysztof Z
Kenneth C. Arnold, Krysta Chauncey, and Krzysztof Z. Gajos. 2020. Predictive text encourages predictable writing. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI ’20). Association for Computing Machinery, New York, NY, USA, 128–138. https://doi.org/10.1145/ 3377325.3377523
arXiv 2020
-
[6]
Ayres and K
R.U. Ayres and K. Martinás. 2005.On the Reappraisal of Microeconomics: Economic Growth and Change in a Material World . Edward Elgar, Cheltenham, United Kingdom. https://books.google.com/books?id=ksxK7J95IF8C C&C ’25, June 23–25, 2025, Virtual, United Kingdom Zhou et al
2005
-
[7]
Carmen Bambach, Rachel Stern, Alison Manges, and Metropolitan Museum of Art (New York, N.Y.). 2003. Leonardo Da Vinci Master Draftsman: Catalogue to an Exhibition at The Metropolitan Museum of Art, New York 2003 . Metropolitan Museum of Art. https://books.google.com/books?id=QwQxDJMKRE4C
2003
-
[8]
Charles Bazerman et al. 1994. Systems of genres and the enactment of social intentions. Genre and the new rhetoric 79101 (1994), 9780203393277–14
1994
Show all 132 references
-
[9]
Carol Berkenkotter. 2001. Genre Systems at Work: DSM-IV and Rhetori- cal Recontextualization in Psychotherapy Paperwork. Written Communi- cation 18, 3 (2001), 326–349. https://doi.org/10.1177/0741088301018003004 arXiv:https://doi.org/10.1177/0741088301018003004
2001 doi
-
[11]
Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. In Advances in Neural Information Processing Systems, D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. ...
2016
-
[12]
Alice G. Brand. 1987. The Why of Cognition: Emotion and the Writing Process. College Composition and Communication 38, 4 (1987), 436–443. http://www. jstor.org/stable/357637
1987
-
[13]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/ 1478088706qp063oa
2006
-
[14]
Aoife Cahill, James Bruno, James Ramey, Gilmar Ayala Meneses, Ian Blood, Florencia Tolentino, Tamar Lavee, and Slava Andreyev. 2021. Supporting Spanish Writers using Automated Feedback. In Proceedings of the 2021 Conference of the North American Chapter of the Association for ...
2021 doi
-
[15]
George Cameron. 2024. LLM Leaderboard - Comparison of GPT-4o, Llama 3, Mistral, Gemini and over 30 models. https://artificialanalysis.ai/leaderboards/ models
2024
-
[16]
Card, George G
Stuart K. Card, George G. Robertson, and Jock D. Mackinlay. 1991. The in- formation visualizer, an information workspace. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New Orleans, Louisiana, USA) (CHI ’91). Association for Computing Machinery,...
1991
-
[17]
Dashiel Carrera and Sang Won Lee. 2022. Watch Me Write: Exploring the Effects of Revealing Creative Writing Process through Writing Replay. InProceedings of the 14th Conference on Creativity and Cognition (Venice, Italy) (C&C ’22) . Association for Computing Machinery, New Yor...
2022
-
[18]
Charlie Chen, Sebastian Borgeaud, Geoffrey Irving, Jean-Baptiste Lespiau, Lau- rent Sifre, and John Jumper. 2023. Accelerating Large Language Model Decoding with Speculative Sampling. arXiv:2302.01318 [cs.CL] https://arxiv.org/abs/2302. 01318
2023 arXiv
-
[19]
Jason Chen and Byron Milligan. 2023. quilljs.com
2023
-
[20]
Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces (Tokyo, Japan) (IUI ’18). Association for Co...
2018
-
[21]
Olanubi, Joseph M
Michelle Cohn, Mahima Pushkarna, Gbolahan O. Olanubi, Joseph M. Moran, Daniel Padgett, Zion Mengesha, and Courtney Heldreth. 2024. Believing An- thropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Models. In Extended Abstracts of the CHI Confe...
2024
-
[22]
Richard M. Collier. 1983. The Word Processor and Revision Strategies. College Composition and Communication 34, 2 (1983), 149–155. http://www.jstor.org/ stable/357402
1983
-
[23]
Federal Communications Commission. 2014. Closed Captioning of Video Pro- gramming. , 20–23 pages. https://docs.fcc.gov/public/attachments/FCC-14- 12A1.pdf FCC-14-12A1
2014
-
[24]
Javier Conde, Miguel González, Pedro Reviriego, Zhen Gao, Shanshan Liu, and Fabrizio Lombardi. 2024. Speed and Conversational Large Language Models: Not All Is About Tokens per Second. Computer 57, 8 (2024), 74–80. https: //doi.org/10.1109/MC.2024.3399384
2024
-
[25]
British Broadcasting Corporation. 2024. Subtitle Guidelines. https://www.bbc. co.uk/accessibility/forproducts/guides/subtitles/ Version 1.2.3
2024
-
[26]
Chris Cundy and Stefano Ermon. 2024. SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking. arXiv:2306.05426 [cs.LG] https://arxiv.org/abs/2306.05426
2024 arXiv
-
[27]
Peter Dalsgaard. 2017. Instruments of inquiry: Understanding the nature and role of tools in design. International Journal of Design 11, 1 (2017), 21–33
2017
-
[28]
Hai Dang, Karim Benharrak, Florian Lehmann, and Daniel Buschek. 2022. Be- yond Text Generation: Supporting Writers with Continuous Automatic Text Summaries. In Proceedings of the 35th Annual ACM Symposium on User In- terface Software and Technology (Bend, OR, USA) (UIST ’22). ...
2022
-
[29]
Dave and David R
Anish M. Dave and David R. Russell. 2010. Drafting and Revision Using Word Processing by Undergraduate Student Writers: Changing Conceptions and Practices. Research in the Teaching of English 44, 4 (2010), 406–434. http: //www.jstor.org/stable/25704888
2010
-
[30]
Haiwei Dong and Shuang Xie. 2024. Large Language Models (LLMs): De- ployment, Tokenomics and Sustainability. arXiv:2405.17147 [cs.MM] https: //arxiv.org/abs/2405.17147
2024 arXiv
-
[31]
Fiona Draxler, Anna Werner, Florian Lehmann, Matthias Hoppe, Albrecht Schmidt, Daniel Buschek, and Robin Welsch. 2024. The AI ghostwriter effect: When users do not perceive ownership of AI-generated text but self-declare as authors. ACM Transactions on Computer-Human Interacti...
2024
-
[32]
Elkin, Matthew Kay, James J
Lisa A. Elkin, Matthew Kay, James J. Higgins, and Jacob O. Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing ...
2021
-
[33]
Franz Faul, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. 2007. G*Power 3: A flexible statistical power analysis program for the social, be- havioral, and biomedical sciences. Behavior Research Methods 39, 2 (2007), 175–191
2007
-
[34]
Linda Flower and John R. Hayes. 1980. The Cognition of Discovery: Defining a Rhetorical Problem. College Composition and Communication 31, 1 (1980), 21–32. http://www.jstor.org/stable/356630
1980
-
[35]
Linda Flower and John R. Hayes. 1981. A Cognitive Process Theory of Writing. College Composition and Communication 32, 4 (1981), 365–387. http://www. jstor.org/stable/356600
1981
-
[36]
Gabriel, Jilin Chen, and Jeffrey Nichols
Richard P. Gabriel, Jilin Chen, and Jeffrey Nichols. 2015. InkWell: A Creative Writer’s Creative Assistant. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (Glasgow, United Kingdom) (C&C ’15). Association for Computing Machinery, New York, NY, USA,...
2015
-
[37]
Darren George and Paul Mallery. 2016. IBM SPSS Statistics 23 Step by Step: A Simple Guide and Reference . Routledge, Taylor & Francis Group
2016
-
[38]
Katy Gero, Alex Calderwood, Charlotte Li, and Lydia Chilton. 2022. A Design Space for Writing Support Tools Using a Cognitive Process Model of Writing. In Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022), Ting-Hao ’Kenneth’ ...
2022 doi
-
[39]
Katy Ilonka Gero and Lydia B. Chilton. 2019. Metaphoria: An Algorithmic Companion for Metaphor Creation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19) . Association for Computing Machinery, New York, NY, USA, 1...
2019
-
[40]
Katy Ilonka Gero, Vivian Liu, and Lydia Chilton. 2022. Sparks: Inspiration for Science Writing using Language Models. In Proceedings of the 2022 ACM Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY...
2022
-
[41]
Katy Ilonka Gero, Tao Long, and Lydia B Chilton. 2023. Social Dynamics of AI Support in Creative Writing. InProceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Articl...
2023
-
[42]
Vinod Goel and Peter Pirolli. 1992. The structure of Design Problem Spaces.Cog- nitive Science 16, 3 (1992), 395–429. https://doi.org/10.1207/s15516709cog1603_3 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1207/s15516709cog1603_3
1992 doi
-
[43]
Google. 2024. Gemini. https://gemini.google.com/
2024
-
[44]
Gross, A
A. Gross, A. Hamlin, B. Merck, C. Rubio, J. Naas, M. Savage, and M. DeSilva
-
[45]
Amit Gupta and James Yu. 2024. sudowrite.com. https://www.sudowrite.com/
2024
-
[46]
Hill, David L
Charles A. Hill, David L. Wallace, and Christina Haas. 1991. Revising on-line: Computer technologies and the revising process. Computers and Composition 9, 1 (1991), 83–109. https://doi.org/10.1016/8755-4615(91)80040-K
1991 doi
-
[47]
Joo-Wha Hong, Ignacio Cruz, and Dmitri Williams. 2021. AI, you can drive my car: How we evaluate human drivers vs. self-driving cars. Computers in Human Behavior 125 (2021), 106944. https://doi.org/10.1016/j.chb.2021.106944 Thoughtful, Confused, or Untrustworthy: How Text Pres...
2021
-
[48]
Joo Wha Hong, Qiyao Peng, and Dmitri Williams. 2021. Are you ready for artificial Mozart and Skrillex? An experiment testing expectancy violation theory and AI music. New Media & Society 23, 7 (2021), 1920–1935. https://doi. org/10.1177/1461444820925798 arXiv:https://doi.org/1...
2021 doi
-
[49]
Julie Hui and Michelle L. Sprouse. 2023. Lettersmith: Scaffolding Written Pro- fessional Communication Among College Students. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New...
2023
-
[50]
Hui, Darren Gergle, and Elizabeth M
Julie S. Hui, Darren Gergle, and Elizabeth M. Gerber. 2018. IntroAssist: A Tool to Support Writing Introductory Help Requests. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, ...
2018
-
[51]
Celia Hunt and Fiona Sampson. 1998. The Self on the Page: Theory and Practice of Creative Writing in Personal Development . Jessica Kingsley Publishers
1998
-
[52]
Sun Young Hwang, Negar Khojasteh, and Susan R. Fussell. 2019. When Delayed in a Hurry: Interpretations of Response Delays in Time-Sensitive Instant Mes- saging. Proc. ACM Hum.-Comput. Interact. 3, GROUP, Article 234 (dec 2019), 20 pages. https://doi.org/10.1145/3361115
2019 doi
- [53]
-
[55]
Carl Jensema, Ralph McCann, and Scott Ramsey. 1996. Closed-Captioned Tele- vision Presentation Speed and Vocabulary. American Annals of the Deaf 141, 4 (1996), 284–292
1996
-
[56]
Andrea Karsten. 2014. Writing: Movements of the self. Theory & Psy- chology 24, 4 (2014), 479–503. https://doi.org/10.1177/0959354314541020 arXiv:https://doi.org/10.1177/0959354314541020
2014 doi
-
[57]
Hancock, and Michael S
Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T. Hancock, and Michael S. Bernstein. 2020. Conceptual Metaphors Impact Perceptions of Human-AI Col- laboration. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 163 (oct 2020), 26 pages. https://doi.org/10.1145/3415234
2020 doi
-
[58]
Anjali Khurana, Hariharan Subramonyam, and Parmit K Chilana. 2024. Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-Seeking. In Proceedings of the 29th International Conference on Intelligent User In...
2024
-
[60]
JP Kincaid. 1975. Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Chief of Naval Technical Training (1975)
1975
-
[61]
Kirschenbaum
M.G. Kirschenbaum. 2016. Track Changes: A Literary History of Word Processing . Harvard University Press. https://books.google.com/books?id=viy7CwAAQBAJ
2016
-
[62]
John Lee and Neville Moray. 1992. Trust, control strategies and al- location of function in human-machine systems. Ergonomics 35, 10 (1992), 1243–1270. https://doi.org/10.1080/00140139208967392 arXiv:https://doi.org/10.1080/00140139208967392 PMID: 1516577
1992 doi
-
[63]
Alghamdi, Tal August, Avinash Bhat, Madiha Zahrah Choksi, Senjuti Dutta, Jin L.C
Mina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum, Vipul Raheja, Hua Shen, Subhashini Venugopalan, Thiemo Wambsganss, David Zhou, Emad A. Alghamdi, Tal August, Avinash Bhat, Madiha Zahrah Choksi, Senjuti Dutta, Jin L.C. Guo, Md Naimul Hoque, Yewon Kim, S...
2024
-
[64]
Mina Lee, Percy Liang, and Qian Yang. 2022. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for...
2022
-
[65]
Brenda Leong and Evan Selinger. 2019. Robot Eyes Wide Shut: Understanding Dishonest Anthropomorphism. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* ’19). Association for Computing Machinery, New York, NY, USA, 299–308. ...
2019
-
[66]
Jiachen Liu, Zhiyu Wu, Jae-Won Chung, Fan Lai, Myungjin Lee, and Mosharaf Chowdhury. 2024. Andes: Defining and Enhancing Quality-of-Experience in LLM-Based Text Streaming Services. arXiv:2404.16283 [cs.DC] https://arxiv. org/abs/2404.16283
2024 arXiv
-
[67]
Xingyu "Bruce" Liu, Jun Zhang, Leonardo Ferrer, Susan Xu, Vikas Bahirwani, Boris Smus, Alex Olwal, and Ruofei Du. 2023. Modeling and Improving Text Stability in Live Captions. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germ...
2023
-
[68]
Duri Long and Brian Magerko. 2020. What is AI Literacy? Competencies and Design Considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–16. https://...
2020
-
[69]
Takuya Maeda and Anabel Quan-Haase. 2024. When Human-AI Interactions Become Parasocial: Agency and Anthropomorphism in Affective Design. In Pro- ceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (Rio de Janeiro, Brazil) (FAccT ’24). Association ...
2024
-
[70]
Bruna Martinuzzi. 2022. Why Talking Too Fast Can Hurt Your Mes- sage. https://www.americanexpress.com/en-us/business/trends-and-insights/ articles/slow-down-why-speaking-too-fast-can-hurt-your-message/
2022
-
[71]
Konstantinos Mavrakakis and Abigail Chipman. 2021. Writing fiction; a phe- nomenological study of the creative writing experience of fiction writers.Modern Psychological Studies 26, 2 (2021), 1–35
2021
-
[72]
Mayer, James H
Roger C. Mayer, James H. Davis, and F. David Schoorman. 1995. An Integrative Model of Organizational Trust. The Academy of Management Review 20, 3 (1995), 709–734. http://www.jstor.org/stable/258792
1995
-
[73]
Meta. 2024. Meta AI. https://www.meta.ai/
2024
-
[74]
Carolyn R. Miller. 1984. Genre as social action. Quarterly Journal of Speech 70, 2 (1984), 151–167. https://doi.org/10.1080/00335638409383686 arXiv:https://doi.org/10.1080/00335638409383686
1984 doi
-
[75]
Donald Murray. 1991. All Writing Is Autobiography. College Composition and Communication 42, 1 (1991), 66–74. http://www.jstor.org/stable/357540
1991
-
[76]
Clifford Nass and Youngme Moon. 2000. Machines and Mind- lessness: Social Responses to Computers. Journal of Social Is- sues 56, 1 (2000), 81–103. https://doi.org/10.1111/0022-4537.00153 arXiv:https://spssi.onlinelibrary.wiley.com/doi/pdf/10.1111/0022-4537.00153
2000
-
[77]
Allen Newell. 1990. Unified theories of cognition . Harvard University Press, USA
1990
-
[78]
Preston Ni. 2019. Do You Talk Too Fast? How to Slow Down. https: //www.psychologytoday.com/us/blog/communication-success/201911/do- you-talk-too-fast-how-to-slow-down
2019
-
[79]
Jakob Nielsen. 1993. Response Times: The 3 Important Limits. https://www. nngroup.com/articles/response-times-3-important-limits/
1993
-
[80]
Jakob Nielsen. 1994. Usability Engineering. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA
1994
-
[81]
Niles, Kate E
Andrea N. Niles, Kate E. Byrne Haltom, Catherine M. Mulvenna, Matthew D. Lieberman, and Annette L. Stanton. [n. d.]. Randomized controlled trial of expressive writing for psychological and physical health: the moderating role of emotional expressivity. 27, 1 ([n. d.]), 1–17. h...
-
[82]
Geoff Norman. 2010. Likert scales, levels of measurement and the “laws” of statistics. Advances in health sciences education 15 (2010), 625–632
2010
-
[83]
Jekaterina Novikova, Ondřej Dušek, and Verena Rieser. 2018. RankME: Reliable human ratings for natural language generation. arXiv preprint arXiv:1803.05928 (2018)
2018 arXiv
-
[84]
NVIDIA. 2024. NIM for LLM Benchmarking Guide | Metrics. https://docs. nvidia.com/nim/benchmarking/llm/latest/metrics.html
2024
-
[85]
OpenAI. 2024. ChatGPT. https://chat.openai.com
2024
-
[86]
OpenAI. 2024. Streaming. https://platform.openai.com/docs/api-reference/ streaming
2024
-
[87]
OpenAI. 2024. What are tokens and how to count them? https://help.openai. com/en/articles/4936856-what-are-tokens-and-how-to-count-them
2024
-
[88]
Zhenhui Peng, Qingyu Guo, Ka Wing Tsang, and Xiaojuan Ma. 2020. Exploring the Effects of Technological Writing Assistance for Support Providers in Online Mental Health Community. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA...
2020
-
[89]
Hans-Peter Piepho. 2018. Letters in Mean Comparisons: What They Do and Don’t Mean. Agronomy Journal 110, 2 (2018), 431–434. https://doi.org/10.2134/agronj2017.10.0580 arXiv:https://acsess.onlinelibrary.wiley.com/doi/pdf/10.2134/agronj2017.10.0580 C&C ’25, June 23–25, 2025, Vir...
2018 doi
-
[90]
Paul Prior. 2013. Writing/disciplinarity: A sociohistoric account of literate activity in the academy. Routledge
2013
-
[91]
Robert Molloy Raja Parasuraman and Indramani L. Singh. 1993. Perfor- mance Consequences of Automation-Induced ’Complacency’. The Interna- tional Journal of A viation Psychology 3, 1 (1993), 1–23. https://doi.org/10.1207/ s15327108ijap0301_1 arXiv:https://doi.org/10.1207/s15327...
1993 doi
-
[92]
Schotter, Michael E
Keith Rayner, Elizabeth R. Schotter, Michael E. J. Masson, Mary C. Potter, and Rebecca Treiman. 2016. So Much to Read, So Little Time: How Do We Read, and Can Speed Reading Help? Psychological Science in the Pub- lic Interest 17, 1 (2016), 4–34. https://doi.org/10.1177/1529100...
2016 doi
-
[93]
Readable. [n. d.]. Flesch Reading Ease and the Flesch Kincaid Grade Level. https: //readable.com/readability/flesch-reading-ease-flesch-kincaid-grade-level/
-
[94]
Microsoft Research. 2023. How to Evaluate LLMs: A Complete Metric Frame- work. https://www.microsoft.com/en-us/research/group/experimentation- platform-exp/articles/how-to-evaluate-llms-a-complete-metric-framework/
2023
-
[95]
Street, Robert M
JR Richard L. Street, Robert M. Brady, and William B. Putman. 1983. The Influence of Speech Rate Stereotypes and Rate Similarity or Lis- teners’ Evaluations of Speakers. Journal of Language and Social Psy- chology 2, 1 (1983), 37–56. https://doi.org/10.1177/0261927X8300200103 ...
1983 doi
-
[96]
Ian Robson. 2022. The Reflective Leader : Reflexivity in Practice . Emerald Pub- lishing Limited, Bingley
2022
-
[97]
Melissa Roemmele and Andrew S. Gordon. 2015. Creative Help: A Story Writing Assistant. In Interactive Storytelling (Lecture Notes in Computer Science) , Henrik Schoenau-Fog, Luis Emilio Bruni, Sandy Louchart, and Sarune Baceviciute (Eds.). Springer International Publishing, Ch...
2015 doi
-
[98]
Melissa Roemmele and Andrew S. Gordon. 2018. Automated Assistance for Creative Writing with an RNN Language Model. In Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion (IUI ’18 Com- panion). Association for Computing Machinery, New York,...
2018
-
[99]
Jonathan Rosenhead. 1996. What’s the Problem? An Introduction to Problem Structuring Methods. Interfaces 26, 6 (December 1996), 117–131. https://doi. org/10.1287/inte.26.6.117
1996 doi
-
[100]
Rousseau, Sim B
Denise M. Rousseau, Sim B. Sitkin, Ronald S. Burt, and Colin Camerer. 1998. In- troduction to Special Topic Forum: Not so Different after All: A Cross-Discipline View of Trust. The Academy of Management Review 23, 3 (1998), 393–404. http://www.jstor.org/stable/259285
1998
-
[101]
Roberts, and Shlomo Zilberstein
Sandhya Saisubramanian, Shannon C. Roberts, and Shlomo Zilberstein. 2021. Understanding User Attitudes Towards Negative Side Effects of AI Systems. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Associatio...
2021 doi
-
[102]
Human-AI Collaboration
Advait Sarkar. 2023. Enough With “Human-AI Collaboration”. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 415, 8 pages. https://doi.org/10.1...
2023
-
[103]
Saumya. 2024. How (and why) to implement streaming in your LLM applica- tion. https://blog.kusho.ai/how-and-why-to-implement-streaming-in-your- llm-application/
2024
-
[104]
Oliver Schmitt and Daniel Buschek. 2021. CharacterChat: Supporting the Cre- ation of Fictional Characters through Conversation and Progressive Manifesta- tion with a Chatbot. InProceedings of the 13th Conference on Creativity and Cogni- tion (Virtual Event, Italy)(C&C ’21). As...
2021
-
[105]
Donald Schön. 1983. The Reflective Practitioner . Basic Books, Perseus Books Group, London
1983
-
[106]
Schraeder
Terry L. Schraeder. 2019. Public Speaking and Presentation Skills. In Physician Communication: Connecting with Patients, Peers, and the Public . Oxford University Press. https://doi.org/10.1093/med/9780190882440.003. 0003 arXiv:https://academic.oup.com/book/0/chapter/265380356...
2019
-
[107]
Andrew Sears, Doreen Revis, Janet Swatski, Rob Crittenden, and Ben Shneiderman. 1993. Investigating touchscreen typing: the effect of keyboard size on typing speed. Behaviour & Information Technol- ogy 12, 1 (1993), 17–22. https://doi.org/10.1080/01449299308924362 arXiv:https:...
1993 doi
-
[108]
Johnson Sheehan
Richard D. Johnson Sheehan. 1999. Metaphor as Hermeneutic. Rhetoric Society Quarterly 29, 2 (1999), 47–64. http://www.jstor.org/stable/3886085
1999
-
[109]
Glassman
Nikhil Singh, Guillermo Bernal, Daria Savchenko, and Elena L. Glassman. 2023. Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence. ACM Trans. Comput.-Hum. Interact. 30, 5, Article 68 (sep 2023), 57 pages. https://doi.org/10.1145/3511599
2023 doi
-
[110]
Marita Skjuve, Asbjørn Følstad, and Petter Bae Brandtzaeg. 2023. The User Experience of ChatGPT: Findings from a Questionnaire Study of Early Users. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI ’23). Associa...
2023
-
[111]
Bruce Smith, Bruce Brown, William Strong, and Alvin Rencher. 1975. Effects of Speech Rate on Personality Perception. Language and speech 18 (04 1975), 145–52. https://doi.org/10.1177/002383097501800203
1975 doi
-
[112]
Nancy I. Sommers. 1980. Revision Strategies of Student Writers and Experienced Adult Writers. College Composition and Communication 31 (1980), 378–387. https://www.jstor.org/stable/356588
1980
-
[113]
Agnieszka Szarkowska and Olivia Gerber-Morón. 2018. Viewers can keep up with fast subtitles: Evidence from eye movements. PloS one 13, 6 (2018), e0199331
2018
-
[114]
Mingyan Claire Tian, James Eschrich, and Sarah Sterman. 2024. Designing AI with Metaphors: Leveraging Ambiguity and Defamiliarization to Support Design Creativity. InProceedings of the 16th Conference on Creativity & Cognition (Chicago, IL, USA) (C&C ’24). Association for Comp...
2024
-
[115]
Tombaugh, Michael D
Jo W. Tombaugh, Michael D. Arkin, and Richard F. Dillion. 1985. The effect of VDU text-presentation rate on reading comprehension and reading speed. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Francisco, California, USA)(CHI ’85). Associa...
1985
-
[116]
Sherry Turkle. 1984. The second self: computers and the human spirit . Simon & Schuster, Inc., USA
1984
-
[117]
Vanneste and Phanish Puranam
Bart S. Vanneste and Phanish Puranam. 2024. Artificial Intelligence, Trust, and Perceptions of Agency. Academy of Management Re- view 0, ja (2024), amr.2022.0041. https://doi.org/10.5465/amr.2022.0041 arXiv:https://doi.org/10.5465/amr.2022.0041
2024
-
[118]
Thiemo Wambsganss and Christina Niklaus. 2022. Modeling Persuasive Dis- course to Adaptively Support Students’ Argumentative Writing. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), Smaranda Muresan, Preslav...
2022 doi
-
[119]
Dakuo Wang, Haodan Tan, and Tun Lu. 2017. Why Users Do Not Want to Write Together When They Are Writing Together: Users’ Rationales for Today’s Collaborative Writing Practices. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 107 (dec 2017), 18 pages. https://doi.org/10.1145/3134742
2017 doi
-
[120]
Florian Weber, Thiemo Wambsganss, Seyed Parsa Neshaei, and Matthias Soellner
-
[121]
Wobbrock, Leah Findlater, Darren Gergle, and James J
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins
-
[122]
Woolridge, Amy-May Leach, Chelsea Blake, and Elizabeth Elliott
Lyndsay R. Woolridge, Amy-May Leach, Chelsea Blake, and Elizabeth Elliott
-
[123]
Yonghui Wu. 2018. Smart Compose: Using Neural Networks to Help Write Emails. https://research.google/blog/smart-compose-using-neural-networks- to-help-write-emails/
2018
-
[124]
Koji Yatani. 2016. Effect Sizes and Power Analysis in HCI . Springer International Publishing, Cham, 87–110. https://doi.org/10.1007/978-3-319-26633-6_5
2016 doi
-
[125]
Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces (IUI ’22) . Association for Computing Machinery, New York, NY, USA, 841–852. https://doi.org/10.11...
2022
-
[126]
Mireia Yurrita, Tim Draws, Agathe Balayn, Dave Murray-Rust, Nava Tintarev, and Alessandro Bozzon. 2023. Disentangling Fairness Perceptions in Al- gorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability. In Proceedings of the 2023 CHI Confere...
2023
-
[127]
Zheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, and Toby Jia-Jun Li. 2023. VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Franci...
2023
-
[128]
Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang
-
[129]
David Zhou and Sarah Sterman. 2023. Creative Struggle: Arguing for the Value of Difficulty in Supporting Ownership and Self-Expression in Creative Writing. In Proceedings of the Second Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2023) . https://cdn.g...
2023
-
[130]
David Zhou and Sarah Sterman. 2024. Ai.llude: Investigating Rewriting AI- Generated Text to Support Creative Expression. In Proceedings of the 16th Conference on Creativity & Cognition (Chicago, IL, USA) (C&C ’24) . Asso- ciation for Computing Machinery, New York, NY, USA, 241...
2024
-
[133]
In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , Martha Palmer, Rebecca Hwa, and Sebastian Riedel (Eds.)
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , Martha Palmer, Rebecca Hwa, and Sebastian Riedel (Eds.). Association for Computational Linguis...
2017 doi
-
[2011]
In Proceedings of the SIGCHI Conference on Hu- man Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11)
The aligned rank transform for nonparametric factorial analyses us- ing only anova procedures. In Proceedings of the SIGCHI Conference on Hu- man Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11) . As- sociation for Computing Machinery, New York, NY, USA, 143–146....
-
[2017]
Open Oregon Educational Resources
Technical Writing. Open Oregon Educational Resources. https://books. google.com/books?id=pxKMzQEACAAJ
-
[2023]
In Findings of the Association for Computational Linguistics: ACL 2023 , Anna Rogers, Jordan Boyd-Graber, and Naoaki Okazaki (Eds.)
Structured Persuasive Writing Support in Legal Education: A Model and Tool for German Legal Case Solutions. In Findings of the Association for Computational Linguistics: ACL 2023 , Anna Rogers, Jordan Boyd-Graber, and Naoaki Okazaki (Eds.). Association for Computational Lingui...
2023 doi
-
[2024]
Journal of Language and Social Psy- chology 43, 2 (2024), 195–223
Do Accents Speak Louder Than Words? Perceptions of Linguistic Speech Characteristics on Deception Detection. Journal of Language and Social Psy- chology 43, 2 (2024), 195–223. https://doi.org/10.1177/0261927X231209428 arXiv:https://doi.org/10.1177/0261927X231209428
2024 doi
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.