GPT-4o identified only 21.2% of the usability issues found by human experts in heuristic evaluation, while discovering 27 additional issues and exhibiting difficulties with certain heuristics and generating false positives.
LLMs’ ways of seeing User Personas, Sept
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
fields
cs.HC 2years
2025 2representative citing papers
A scoping review of 81 articles finds generative AI widely applied to persona development with 61% resource sharing but 45% lacking evaluation and frequent GPT-only use, proposing guidelines to address circularity and reduced human oversight.
citing papers explorer
-
Can GPT-4o Evaluate Usability Like Human Experts? A Comparative Study on Issue Identification in Heuristic Evaluation
GPT-4o identified only 21.2% of the usability issues found by human experts in heuristic evaluation, while discovering 27 additional issues and exhibiting difficulties with certain heuristics and generating false positives.
-
Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles
A scoping review of 81 articles finds generative AI widely applied to persona development with 61% resource sharing but 45% lacking evaluation and frequent GPT-only use, proposing guidelines to address circularity and reduced human oversight.